-- Logs begin at Wed 2022-07-27 08:19:37 UTC, end at Wed 2022-07-27 09:27:44 UTC. -- Jul 27 08:56:02.744443 dv-cinder-797608-64-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 08:56:02.753177 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 08:56:02 2022] *** Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: nodename: dv-cinder-797608-64-iscsi Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: machine: x86_64 Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: clock source: unix Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: pcre jit disabled Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: detected number of CPU cores: 4 Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: current working directory: / Jul 27 08:56:02.755145 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: detected binary path: /usr/bin/uwsgi-core Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: your processes number limit is 47680 Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: your memory page size is 4096 bytes Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: detected max file descriptor number: 2048 Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: lock engine: pthread robust mutexes Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: thunder lock: enabled Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 08:56:02.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 08:56:02.795638 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: Python main interpreter initialized at 0x55887a9139c0 Jul 27 08:56:02.795638 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: python threads support enabled Jul 27 08:56:02.795638 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: your server socket listen backlog is limited to 100 connections Jul 27 08:56:02.795638 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: your mercy for graceful operations on workers is 90 seconds Jul 27 08:56:02.796058 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 08:56:02.796142 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: *** Operational MODE: preforking *** Jul 27 08:56:02.796356 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: *** uWSGI is running in multiple interpreter mode *** Jul 27 08:56:02.796356 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: spawned uWSGI master process (pid: 103379) Jul 27 08:56:02.796553 dv-cinder-797608-64-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 08:56:02.797962 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: spawned uWSGI worker 1 (pid: 103380, cores: 1) Jul 27 08:56:02.797962 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: spawned uWSGI worker 2 (pid: 103381, cores: 1) Jul 27 08:56:02.797962 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 08:56:03.461717 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:56:03.462328 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:56:04.539506 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:56:04.539506 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: from cryptography.utils import int_from_bytes Jul 27 08:56:04.540272 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:56:04.540272 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: from cryptography.utils import int_from_bytes Jul 27 08:56:04.550339 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:56:04.550339 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: from cryptography.utils import int_from_bytes Jul 27 08:56:04.550799 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:56:04.550799 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: from cryptography.utils import int_from_bytes Jul 27 08:56:07.047808 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:56:07.048345 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:56:07.048486 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:56:07.048845 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:56:07.049092 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:56:07.049472 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.049793 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.049897 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:56:07.050261 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.050344 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:56:07.050422 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.050663 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:56:07.050764 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.051007 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.051096 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:56:07.051270 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:56:07.051363 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.051623 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.051731 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.051969 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052073 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052224 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052312 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052531 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052619 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052850 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-64-iscsi {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.052938 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053164 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053251 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053466 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053555 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053771 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.053858 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054082 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054177 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054382 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054473 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054700 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054817 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.054996 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.055103 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-64-iscsi {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.055330 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.055481 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.055640 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.056713 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.056826 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.056899 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.056971 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057048 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057126 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057199 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057274 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057341 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057412 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057621 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057717 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.057936 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058031 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058241 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058329 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058565 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058666 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.058909 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059046 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059207 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059315 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-64-iscsi {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059516 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059624 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.059870 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060060 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060296 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060428 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060660 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060791 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.060969 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.061112 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.061291 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.061429 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-64-iscsi {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.061611 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.061828 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062041 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062258 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062466 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062677 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062838 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.062942 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063025 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063122 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063263 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063464 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063553 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063711 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.063902 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064040 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064212 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064342 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064542 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064656 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064862 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.064965 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065182 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065269 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065474 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065642 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065776 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.065863 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066085 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066185 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066395 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066481 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066707 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066797 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.066954 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067058 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067200 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067295 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067514 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067616 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067847 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.067956 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068153 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068241 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068452 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068546 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068757 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.068913 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069011 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069091 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069259 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069358 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069577 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069673 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069896 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.069992 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070203 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070300 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070513 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070609 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070817 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.070902 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071120 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071214 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071421 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071508 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071722 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.071857 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072052 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072161 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072359 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072446 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072659 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072746 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.072977 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073290 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073384 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073592 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073679 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073903 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.073999 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074216 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074303 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074517 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074604 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074815 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.074904 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.075114 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.075212 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.075425 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.075519 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076297 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076388 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076599 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076686 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076844 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.076944 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077142 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077229 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077440 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077538 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077751 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.077848 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078050 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078136 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078347 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078435 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078644 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078740 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.078937 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079023 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079238 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079330 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079533 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079632 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079852 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.079945 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080152 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080251 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080450 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080546 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080746 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.080840 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081043 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081137 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081339 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081428 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081636 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081733 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.081937 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082033 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082242 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082330 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082537 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082630 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082835 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.082924 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083130 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083219 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083426 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083515 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083729 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.083840 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084057 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084144 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084338 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084433 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084651 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084745 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.084951 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085039 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085249 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085340 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085552 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085646 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085848 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.085942 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086145 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086242 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086452 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086547 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086742 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.086830 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087041 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087128 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087348 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087447 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087647 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087735 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.087978 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088076 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088274 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088369 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088571 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088658 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088869 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.088975 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089167 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089269 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089464 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089550 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089759 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.089845 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090052 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090162 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090353 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090447 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090657 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090750 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.090955 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.091050 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.091275 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.091955 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092172 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092263 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092500 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092590 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092782 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.092871 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.093104 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.093192 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.093427 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.093560 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.093735 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.093822 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.094040 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.094127 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.094348 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.094443 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.094667 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:56:07.094754 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.094992 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095088 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095302 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095409 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095623 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095711 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.095962 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096063 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096268 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096367 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096574 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096668 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.096988 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097191 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097278 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097513 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097607 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097822 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.097917 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098135 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098222 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098445 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098542 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098749 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.098845 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099059 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099147 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099373 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099458 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099687 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.099850 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100017 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100105 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100332 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100420 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100747 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.100967 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101055 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101283 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101375 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101596 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101685 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101902 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.101990 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102209 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102352 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102514 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102603 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102831 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.102926 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103156 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103243 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103460 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103548 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103786 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.103881 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104096 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104196 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104400 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104704 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.104828 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105009 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105105 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105309 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105433 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105640 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105727 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.105948 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106114 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106258 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106344 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106562 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.106903 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107007 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107211 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107298 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107517 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107613 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107850 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.107961 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108153 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108245 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108453 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108542 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108752 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.108851 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109057 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109145 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109361 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109448 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109673 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109769 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.109985 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110079 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110285 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110596 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110700 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.110905 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111032 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111205 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111301 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111508 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111604 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.111887 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112002 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112133 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112251 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112439 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112527 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112745 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.112832 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113045 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113207 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113420 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113672 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113797 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.113999 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114089 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114318 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114425 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114616 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114702 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.114916 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115002 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115225 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115313 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115531 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115616 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115857 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.115959 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116169 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116265 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116476 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116564 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116798 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.116896 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117104 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117198 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117412 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117489 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117792 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.117899 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118041 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118129 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118343 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118429 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118658 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118753 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.118974 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119061 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119289 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119375 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119591 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119681 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.119924 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120014 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120227 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120326 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120528 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120618 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120829 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.120917 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121133 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121219 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121432 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121528 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121731 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.121820 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122031 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122127 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122328 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122416 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122661 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122748 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.122977 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123073 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123280 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123368 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123578 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123665 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.123907 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124013 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124206 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124294 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124532 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124620 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124831 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.124926 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125134 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125223 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125457 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125544 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125769 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.125879 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126074 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126161 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126378 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126465 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126682 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126771 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.126987 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127081 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127294 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127390 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127599 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127689 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.127932 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128024 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128248 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128344 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128554 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128644 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128868 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.128956 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129178 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129265 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129498 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129592 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129801 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.129888 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130112 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130206 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130409 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130495 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130718 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.130805 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131038 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131134 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131360 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131455 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131668 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.131774 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132011 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132112 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132317 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132413 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132625 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132717 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.132929 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133024 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133233 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133320 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133536 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133624 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133842 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.133952 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134154 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134245 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134460 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134547 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.134860 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135074 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135204 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135391 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135481 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135695 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.135803 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136030 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136118 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136330 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136638 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136727 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.136947 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137034 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137266 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137354 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137570 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137657 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137875 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.137962 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.138737 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.138841 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139046 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139139 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139350 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139436 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139655 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139805 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.139986 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140074 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140286 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140384 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140589 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140687 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140898 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.140986 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141203 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141290 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141506 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141604 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141805 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.141899 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142112 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142200 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142414 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142511 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142711 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.142800 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143008 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143102 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143311 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143407 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143620 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143707 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.143959 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144048 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144270 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144361 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144580 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144667 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144878 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.144973 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145176 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145306 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145478 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145572 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145782 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.145919 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146079 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146167 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146374 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146671 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.146768 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147006 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147095 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147310 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147395 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147606 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147700 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.147942 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148031 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148251 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148349 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148557 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148659 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148862 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.148950 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149165 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149253 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149470 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149555 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149794 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.149889 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150100 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150185 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150402 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150501 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150712 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.150845 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151038 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151147 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151308 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151399 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151613 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151708 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.151958 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152049 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152263 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152361 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152569 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152674 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152876 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.152977 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.153173 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.153263 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.153476 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.153573 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.154339 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.154441 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.154646 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.154942 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155031 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155328 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155430 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155581 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155671 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.155921 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156087 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156229 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156365 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156511 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156646 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156834 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.156967 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.157153 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.157466 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.157613 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.157765 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.157908 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158067 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158205 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158370 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158507 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158671 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158816 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.158976 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159113 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159277 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159433 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159568 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159705 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.159911 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160068 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160218 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160384 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160517 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160739 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160842 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.160988 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161173 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161301 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161400 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161613 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161702 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.161921 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162008 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162228 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162325 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162536 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162625 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.162928 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163036 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163190 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163348 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163495 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163637 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163823 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.163912 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164039 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164142 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164359 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164461 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164663 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164762 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.164969 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165274 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165368 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165598 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165689 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.165910 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166005 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166209 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166297 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166510 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166682 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166815 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.166910 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167113 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167199 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167410 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167506 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167716 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.167825 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168062 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168187 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168362 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168471 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168666 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168757 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.168968 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169056 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169272 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169601 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169689 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169905 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.169993 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170209 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170308 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170507 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170596 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170855 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.170957 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171118 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171312 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171398 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171484 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171695 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.171894 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172023 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172115 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172325 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172414 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172622 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172712 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.172925 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173015 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173223 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173319 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173533 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173621 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173834 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.173934 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174127 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174224 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174423 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174534 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174725 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.174813 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175027 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175116 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175322 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175419 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175631 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175737 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.175966 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176054 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176268 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176387 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176563 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176660 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176864 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.176952 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177158 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177254 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177454 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177543 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177756 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.177846 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178059 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178147 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178502 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178668 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178758 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.178968 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179058 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179346 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179448 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179561 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179887 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.179980 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180189 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180278 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180486 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180576 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180782 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.180872 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181080 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181169 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181377 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181476 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181672 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181770 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.181985 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182073 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182286 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182386 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182672 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182880 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.182969 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183174 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183271 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183475 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183563 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183795 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.183887 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184104 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184205 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184409 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184731 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.184861 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185061 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185150 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185365 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185460 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185670 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185783 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.185971 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186072 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186263 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186363 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186571 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186675 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186874 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.186963 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187177 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187265 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187473 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187561 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187794 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.187972 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188113 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188259 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188403 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188539 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188703 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188842 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.188982 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189116 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189449 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189620 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189762 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.189920 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190063 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190222 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190367 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190524 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190670 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190805 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.190947 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191112 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191267 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191406 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191535 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191704 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.191855 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192033 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192177 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192336 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192486 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192641 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192771 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.192914 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193051 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193216 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193374 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193519 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193607 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193822 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.193912 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194121 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194216 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194438 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194528 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194739 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.194828 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195039 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195176 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195343 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195477 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195621 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195794 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.195928 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196025 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196221 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196321 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196546 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196653 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196851 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.196952 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197176 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197275 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197487 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197576 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197792 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.197889 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198092 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198189 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198393 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198488 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198699 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198786 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.198996 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.199108 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.199412 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.199507 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.199723 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.199876 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.200052 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.200142 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.200356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.200452 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201183 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201336 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201530 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201653 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201785 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.201901 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202101 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202188 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202397 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202495 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202695 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202818 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.202992 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203130 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203306 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203441 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203603 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203772 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.203943 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204079 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204355 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204444 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204661 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204749 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.204960 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205099 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205281 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205370 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205584 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.205890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206032 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206215 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206304 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206535 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206669 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206842 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.206942 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207149 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207261 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207457 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207572 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207774 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.207899 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208108 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208321 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208430 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208635 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208748 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.208949 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209047 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209275 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209364 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209597 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209686 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.209921 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210020 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210227 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210321 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210540 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210628 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210852 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.210954 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211178 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211267 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211503 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211591 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211849 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.211971 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212170 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212269 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212468 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212556 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.212860 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213075 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213165 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213375 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213464 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213675 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213768 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.213991 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214117 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214291 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214443 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214598 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214754 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.214901 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215074 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215199 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215401 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215499 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215707 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.215847 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.216035 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.216123 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.216897 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217000 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217205 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217295 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217513 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217601 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217838 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.217927 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218147 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218237 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218458 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218545 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218767 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.218856 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219071 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219158 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219369 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219464 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219671 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.219780 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220002 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220090 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220311 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220411 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220630 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220719 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.220941 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221028 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221267 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221370 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221591 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221686 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221895 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.221981 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222217 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222314 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222528 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222618 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222833 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.222923 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223138 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223235 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223441 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223531 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.223869 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224068 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224159 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224375 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224471 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224676 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224800 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.224977 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225171 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225298 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225486 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225584 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225855 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.225951 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226155 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226251 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226457 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226546 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226773 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.226875 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227073 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227231 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227387 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227583 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227722 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.227956 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228051 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228292 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228382 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228591 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228689 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.228926 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229024 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229225 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229313 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229549 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229654 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229867 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.229957 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230184 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230273 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230601 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230807 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.230927 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.231125 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.231272 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.231434 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.231658 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.231815 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232063 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232173 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232384 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232487 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232693 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.232782 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233002 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233092 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233310 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233431 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233615 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233763 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.233924 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.234140 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.234236 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.234505 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.234595 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.234890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235041 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235264 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235468 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235608 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235697 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.235985 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236084 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236294 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236394 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236602 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236692 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.236908 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237033 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237214 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237390 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237518 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237751 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.237847 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238073 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238162 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238393 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238482 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238708 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.238905 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239029 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239129 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239349 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239445 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239662 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239770 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.239996 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240218 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240308 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240554 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240649 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240876 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.240964 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241198 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241288 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241515 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241603 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241821 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.241917 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242130 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242227 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242437 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242533 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242742 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.242911 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243046 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243142 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243352 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243450 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243658 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243812 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.243989 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244094 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244295 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244386 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244604 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244693 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.244912 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245001 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245230 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245319 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245559 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245874 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.245963 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246179 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246280 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246484 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246575 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246790 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.246878 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247135 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247304 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247472 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247642 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247819 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.247998 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248134 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248323 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248444 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248656 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248798 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.248955 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249055 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249270 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249366 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249592 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249682 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249899 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.249997 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250199 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250290 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250505 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250596 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250811 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.250909 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251109 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251199 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251428 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251517 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251734 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.251885 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252056 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252145 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252371 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252639 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252744 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.252960 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253189 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253285 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253534 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253624 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253844 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.253934 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254163 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254255 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254483 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254572 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254795 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.254885 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255096 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255185 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255413 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255510 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255714 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.255866 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256038 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256137 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256349 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256450 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256653 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256750 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.256953 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257051 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257252 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257394 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257557 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257646 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257863 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.257953 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.258163 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.258396 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.258486 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.258746 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.258835 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259065 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259165 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259362 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259450 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259665 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259772 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.259990 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260090 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260296 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260387 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260684 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260894 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.260992 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261192 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261282 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261488 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261583 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261791 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.261889 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262089 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262186 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262392 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262482 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262692 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262782 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.262994 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.263599 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.263852 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.263945 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264159 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264249 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264463 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264558 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264792 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.264882 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265101 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265190 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265398 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265492 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265703 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.265789 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266005 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266106 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266309 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266397 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266615 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266713 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.266917 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267006 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267219 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267306 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267531 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267704 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.267857 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268096 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268185 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268425 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268516 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268739 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.268828 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269046 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269133 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269357 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269445 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269666 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269755 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.269966 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270061 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270271 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270378 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270588 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270678 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270894 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.270994 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271201 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271336 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271506 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271595 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271834 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.271930 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272141 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272309 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272445 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272543 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272749 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.272838 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273052 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273314 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273411 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273643 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273731 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.273946 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274044 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274248 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274340 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274549 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274637 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274855 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.274954 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275184 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275286 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275490 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275587 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275820 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.275924 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276134 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276223 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276444 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276531 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276745 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.276834 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277047 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277143 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277350 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277439 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277653 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277745 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.277961 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.278049 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.278272 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.278361 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.278577 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.278666 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.279440 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.279544 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.279797 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.279908 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280082 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280179 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280428 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280540 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280709 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.280810 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281051 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281148 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281509 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281684 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281783 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.281990 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282079 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282305 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282394 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282613 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282702 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.282921 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283008 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283231 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283327 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283539 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283630 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283882 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.283980 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284184 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284272 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284485 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284584 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284783 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.284871 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285087 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285219 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285399 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285531 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285704 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285852 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.285989 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286174 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286287 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286483 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286574 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286807 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.286895 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287131 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287221 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287441 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287530 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287735 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.287850 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288059 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288150 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288445 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288654 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288752 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.288950 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289040 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289246 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289337 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289543 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289640 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289838 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.289927 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290138 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290229 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290437 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290535 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290735 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.290823 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291030 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291127 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291324 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291423 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291620 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291724 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.291967 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292060 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292293 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292391 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292601 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292698 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292904 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.292991 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293207 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293296 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293514 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293602 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293815 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.293910 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294116 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294205 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294443 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294535 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294747 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.294845 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295049 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295136 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295349 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295475 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295658 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295800 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.295985 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296085 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296289 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296377 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296588 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296684 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296891 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.296979 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297191 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297286 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297511 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297608 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297878 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.297978 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298132 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298230 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298452 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298543 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298760 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.298857 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299071 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299159 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299379 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299476 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.299788 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300038 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300128 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300347 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300437 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300651 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300740 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.300954 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301126 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301259 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301356 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301562 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301691 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301872 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.301972 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302178 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302269 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302483 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302572 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302793 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.302890 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303102 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303191 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303425 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303515 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303731 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.303896 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304065 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304153 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304387 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304476 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304706 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.304802 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305020 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305108 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305332 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305434 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305664 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305761 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.305975 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306065 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306283 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306378 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306589 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306680 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306890 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.306986 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.307127 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:56:07.307230 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.307502 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.307836 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.308152 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.308471 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.308791 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.309122 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.309452 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.309766 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.310124 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.310454 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.310803 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.311120 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.311467 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.311824 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.312140 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.312463 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.312772 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:56:07.313016 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:56:07.460107 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Registered counter for database nova_api Jul 27 08:56:07.465821 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Registered counter for database nova_api Jul 27 08:56:07.481222 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.486513 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.488346 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.492858 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.542570 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.context [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c62e0045-c296-455f-b1a2-d948df83e410(cell1) {{(pid=103380) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:56:07.547132 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:56:07.548051 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.context [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c62e0045-c296-455f-b1a2-d948df83e410(cell1) {{(pid=103381) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:56:07.548729 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:56:07.549509 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:56:07.551465 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_concurrency.lockutils [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:56:07.551972 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:56:07.553456 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Registered counter for database nova_cell0 Jul 27 08:56:07.553573 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:56:07.554328 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:56:07.556402 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:56:07.558462 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Registered counter for database nova_cell0 Jul 27 08:56:07.558798 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Registered counter for database nova_cell1 Jul 27 08:56:07.563951 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Registered counter for database nova_cell1 Jul 27 08:56:07.565946 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.568174 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.571357 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.572871 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.573946 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.578998 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.581673 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.708327 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.718764 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO dbcounter [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Registered counter for database nova_cell0 Jul 27 08:56:07.726434 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Registered counter for database nova_cell0 Jul 27 08:56:07.727863 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.733170 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writer thread running {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:07.735885 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:56:07.740631 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:56:08.069530 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:56:08.077272 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:56:08.077582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:56:08.085328 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:56:08.415557 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:56:08.422120 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:56:08.427357 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55887a9139c0 pid: 103381 (default app) Jul 27 08:56:08.429416 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:56:08.430586 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Jul 27 08:56:08.431010 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Wed Jul 27 08:56:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:56:08.431894 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:56:08.438303 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: WARNING keystonemiddleware.auth_token [None req-5c7c2cd4-8a20-4d58-a317-d3b0e938b8e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:56:08.443332 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55887a9139c0 pid: 103380 (default app) Jul 27 08:57:24.629897 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:24.630907 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 27 08:57:24.631484 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:24.644263 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:24.645394 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell1:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:24.646229 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell0:SELECT=3 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:24.647415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:25.594650 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-8e6df7c2-5950-464d-87b7-767f17168d47 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:25.629606 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-8e6df7c2-5950-464d-87b7-767f17168d47 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.990374 Jul 27 08:57:25.635865 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Wed Jul 27 08:57:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:27.853968 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:27.855355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0944dda1-82cb-4112-a757-3b524df6775f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jul 27 08:57:27.856404 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:28.331818 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-0e279736-2dd3-44a3-b973-e8c9afed88d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:28.354513 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:57:28.354513 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: warnings.warn(msg) Jul 27 08:57:28.382691 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-0e279736-2dd3-44a3-b973-e8c9afed88d3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519662 Jul 27 08:57:28.383822 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:57:28.397460 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:28.398577 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell0:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:28.399839 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell1:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:28.401147 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:28.605976 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-72604f6e-1af1-4512-bdc4-35a05fcfb728 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:28.610735 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:57:28.610735 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 08:57:28.684855 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-72604f6e-1af1-4512-bdc4-35a05fcfb728 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292773 Jul 27 08:57:28.696075 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Wed Jul 27 08:57:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:30.939596 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-0e279736-2dd3-44a3-b973-e8c9afed88d3 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:30.940702 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-0e279736-2dd3-44a3-b973-e8c9afed88d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 27 08:57:30.941557 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:31.628069 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-94757f2e-1639-4cf9-a73d-0434e2930d9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:31.646975 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:57:31.646975 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 08:57:31.666607 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-94757f2e-1639-4cf9-a73d-0434e2930d9a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.718373 Jul 27 08:57:31.667466 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:31.679421 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-dd9f2cde-9834-4237-b39b-be6628f00b48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:31.683952 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:57:31.683952 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: warnings.warn(msg) Jul 27 08:57:31.726407 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-dd9f2cde-9834-4237-b39b-be6628f00b48 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050961 Jul 27 08:57:31.727093 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Wed Jul 27 08:57:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:33.956770 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-94757f2e-1639-4cf9-a73d-0434e2930d9a admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:33.957789 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-94757f2e-1639-4cf9-a73d-0434e2930d9a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 27 08:57:33.958198 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:34.338387 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-187be883-d9b7-4323-b09b-ecf284386d83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "disk": 10, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:34.357404 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-187be883-d9b7-4323-b09b-ecf284386d83 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.392749 Jul 27 08:57:34.357961 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:34.369975 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-bcb4fe96-8d23-488b-acfa-63b1bce62418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:34.394138 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-bcb4fe96-8d23-488b-acfa-63b1bce62418 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027895 Jul 27 08:57:34.395140 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Wed Jul 27 08:57:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:36.592779 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-187be883-d9b7-4323-b09b-ecf284386d83 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:36.593938 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-187be883-d9b7-4323-b09b-ecf284386d83 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Jul 27 08:57:36.594390 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:37.037250 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-e345ab26-0852-40d6-9333-96d2b37f018d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "disk": 10, "vcpus": 2}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:37.056209 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-e345ab26-0852-40d6-9333-96d2b37f018d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455616 Jul 27 08:57:37.056812 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:57:37.070589 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-483271d4-81b0-4f35-b851-c1a8c1b0abbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:37.096954 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-483271d4-81b0-4f35-b851-c1a8c1b0abbb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030353 Jul 27 08:57:37.107135 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Wed Jul 27 08:57:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:39.316416 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-e345ab26-0852-40d6-9333-96d2b37f018d admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:39.317485 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-e345ab26-0852-40d6-9333-96d2b37f018d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 27 08:57:39.318148 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:39.770786 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "d4", "name": "ds4G", "disk": 20, "rxtx_factor": 1.0}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:39.791169 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467168 Jul 27 08:57:39.791844 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:39.803914 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-1d31ffb1-48e0-4f8f-8ca2-280e5b0b6e7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:39.831166 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-1d31ffb1-48e0-4f8f-8ca2-280e5b0b6e7c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030676 Jul 27 08:57:39.831762 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Wed Jul 27 08:57:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:42.188055 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:42.189118 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Jul 27 08:57:42.189548 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:42.643149 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-63833bb1-7bcc-4d3e-b948-9798f169f497 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:42.668420 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-63833bb1-7bcc-4d3e-b948-9798f169f497 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471158 Jul 27 08:57:42.668981 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Wed Jul 27 08:57:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:57:44.901996 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:44.903042 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-5cc26ed8-053c-4e14-a16e-7e51fe916fea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 27 08:57:44.903424 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:45.372452 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-3ea5fd12-42f9-43e2-9657-22dbc5568a00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:45.393649 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-3ea5fd12-42f9-43e2-9657-22dbc5568a00 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.484011 Jul 27 08:57:45.394203 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:57:45.406466 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-2827e697-970e-4ac6-855a-9356d6f8067a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:45.432061 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-2827e697-970e-4ac6-855a-9356d6f8067a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029132 Jul 27 08:57:45.432671 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Wed Jul 27 08:57:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:47.675299 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-3ea5fd12-42f9-43e2-9657-22dbc5568a00 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:47.677207 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-3ea5fd12-42f9-43e2-9657-22dbc5568a00 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002504 Jul 27 08:57:47.677682 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:48.094533 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-71ac8d0d-3a6e-4a14-9ca6-cd7c62a88704 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "id": "2"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:48.114843 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-71ac8d0d-3a6e-4a14-9ca6-cd7c62a88704 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430347 Jul 27 08:57:48.115397 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:48.127289 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-da21a8eb-4daa-4764-9cea-f25f6e8c7a34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:48.153864 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-da21a8eb-4daa-4764-9cea-f25f6e8c7a34 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030419 Jul 27 08:57:48.154652 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Wed Jul 27 08:57:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:50.350946 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-71ac8d0d-3a6e-4a14-9ca6-cd7c62a88704 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:50.352036 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-71ac8d0d-3a6e-4a14-9ca6-cd7c62a88704 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 27 08:57:50.352440 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:50.789269 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-cdd6ca51-500e-4758-b1d8-6a8884d141ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 40, "id": "3", "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:50.808513 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-cdd6ca51-500e-4758-b1d8-6a8884d141ba admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449903 Jul 27 08:57:50.809061 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:50.820738 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-cb96049c-8c0c-419d-97c0-867d54733f9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:50.845523 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-cb96049c-8c0c-419d-97c0-867d54733f9a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028370 Jul 27 08:57:50.846112 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Wed Jul 27 08:57:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:53.088321 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-cdd6ca51-500e-4758-b1d8-6a8884d141ba admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:53.089961 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-cdd6ca51-500e-4758-b1d8-6a8884d141ba admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Jul 27 08:57:53.095466 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:53.566498 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-b5bad3d9-1562-4e63-99cb-1e152f422175 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "4", "name": "m1.large"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:53.587541 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-b5bad3d9-1562-4e63-99cb-1e152f422175 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.490433 Jul 27 08:57:53.588230 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:57:53.600196 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-988b571f-60ae-4c92-b25e-a94bcaa7648f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:53.628995 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-988b571f-60ae-4c92-b25e-a94bcaa7648f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032310 Jul 27 08:57:53.630245 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Wed Jul 27 08:57:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:55.865822 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-b5bad3d9-1562-4e63-99cb-1e152f422175 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:55.867536 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-b5bad3d9-1562-4e63-99cb-1e152f422175 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Jul 27 08:57:55.868054 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:56.310556 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:56.332919 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458859 Jul 27 08:57:56.334079 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Wed Jul 27 08:57:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:57:56.346290 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-94d50b04-34ff-4093-9950-7cd6a04401ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:56.351231 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:56.379266 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-94d50b04-34ff-4093-9950-7cd6a04401ea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034837 Jul 27 08:57:56.379266 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Wed Jul 27 08:57:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:58:16.712599 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:16.713545 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 27 08:58:16.713946 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:16.724268 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:17.241875 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-2c0e30ae-5ac6-45a3-aa77-83751667c8c3 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:17.261954 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-2c0e30ae-5ac6-45a3-aa77-83751667c8c3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.541737 Jul 27 08:58:17.262728 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Wed Jul 27 08:58:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:18.380779 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:18.381793 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-2e55cf8f-7cc8-4f02-90b4-edee3231769f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 27 08:58:18.382197 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:18.920188 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e3e426d3-6b9e-4fd5-913b-5fe6789ff133 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:18.925811 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-e3e426d3-6b9e-4fd5-913b-5fe6789ff133 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e3e426d3-6b9e-4fd5-913b-5fe6789ff133 admin admin] Request method failure captured: Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Host: 10.222.0.33 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4P4qiqrEu3KPXCs-VkTTUBNp-EAjSZAuyT6h5PW15KZtTIY-b1RXql-voT7DWX5vufw7tq_l4gaO7BHVsIGxrjsSKrZdI1Cr1hr7QlB-mhJ2rPnlSr8e-4kziAAF-QbTntB8zfd0u4Nen_1QuTW0wwirwbPgeqoQD13gJV5iL3WOpxc Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Role: admin,reader,member Jul 27 08:58:18.929064 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Roles: admin,reader,member Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User: admin Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: method: > Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: exception: Flavor 42 could not be found. Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: action_args: {'id': '42'} Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:18.931356 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:18.932299 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:18.933401 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e3e426d3-6b9e-4fd5-913b-5fe6789ff133 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:18.940121 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e3e426d3-6b9e-4fd5-913b-5fe6789ff133 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.410450 Jul 27 08:58:18.940667 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Jul 27 08:58:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:18.950362 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0f7a14d7-4e92-4383-8306-7ae402aeca76 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:18.954878 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:18.974418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0f7a14d7-4e92-4383-8306-7ae402aeca76 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027887 Jul 27 08:58:18.974991 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:18.985367 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-1ed57d39-60bc-49fc-b1e5-b9b427c43056 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:19.009683 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-1ed57d39-60bc-49fc-b1e5-b9b427c43056 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027912 Jul 27 08:58:19.010243 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:19.020707 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f745c86f-d663-4a60-bd8d-9be1de3c0bfb admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:19.026623 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-f745c86f-d663-4a60-bd8d-9be1de3c0bfb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f745c86f-d663-4a60-bd8d-9be1de3c0bfb admin admin] Request method failure captured: Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept: application/json Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Connection: keep-alive Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Content-Length: 0 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Host: 10.222.0.33 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi4P4qiqrEu3KPXCs-VkTTUBNp-EAjSZAuyT6h5PW15KZtTIY-b1RXql-voT7DWX5vufw7tq_l4gaO7BHVsIGxrjsSKrZdI1Cr1hr7QlB-mhJ2rPnlSr8e-4kziAAF-QbTntB8zfd0u4Nen_1QuTW0wwirwbPgeqoQD13gJV5iL3WOpxc Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Role: admin,reader,member Jul 27 08:58:19.029890 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Roles: admin,reader,member Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant: admin Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User: admin Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Name: admin Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: method: > Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: exception: Flavor 42 could not be found. Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: action_args: {'id': '42'} Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:19.031418 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:19.032354 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:19.033470 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f745c86f-d663-4a60-bd8d-9be1de3c0bfb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:19.035200 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f745c86f-d663-4a60-bd8d-9be1de3c0bfb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014847 Jul 27 08:58:19.035200 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Jul 27 08:58:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:20.003201 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-1ed57d39-60bc-49fc-b1e5-b9b427c43056 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:20.004249 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-1ed57d39-60bc-49fc-b1e5-b9b427c43056 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 27 08:58:20.004658 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:20.537629 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2bfd6221-6cf6-4842-87ad-ca99e6521465 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:20.542955 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-2bfd6221-6cf6-4842-87ad-ca99e6521465 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2bfd6221-6cf6-4842-87ad-ca99e6521465 admin admin] Request method failure captured: Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept: application/json Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Connection: keep-alive Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Content-Length: 0 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Host: 10.222.0.33 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi4P4rr4eGryXakjfYm2EYgoJkyQ3SoJmbpR2jnONiWpDYM8yE0_JERfZwa7JVVdTccJcdveLgSUshwEutCYgT6Rj-70lDBJgRUKUpBXFnBN-W_i47g5DBFQy4hul7KEypSyEpV_w5yHapFqYHK1lyldozGR3L5TCT-neVpJm9W9Hs2uk Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Role: admin,reader,member Jul 27 08:58:20.544489 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Roles: admin,reader,member Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant: admin Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User: admin Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Name: admin Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: method: > Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: exception: Flavor 84 could not be found. Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: action_args: {'id': '84'} Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:20.546064 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:20.547005 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.548371 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2bfd6221-6cf6-4842-87ad-ca99e6521465 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:20.549586 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-2bfd6221-6cf6-4842-87ad-ca99e6521465 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403457 Jul 27 08:58:20.549586 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Jul 27 08:58:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:20.555783 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-48f39042-9860-458d-9f15-35b9c6555d3a admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:20.571133 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-48f39042-9860-458d-9f15-35b9c6555d3a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019132 Jul 27 08:58:20.571667 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:20.581345 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-eeb258db-276e-4e42-882e-2b21d52ac459 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:20.596999 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-eeb258db-276e-4e42-882e-2b21d52ac459 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019167 Jul 27 08:58:20.597712 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:20.607222 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-76937d46-6362-4861-9221-51617696b2fc admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:20.612623 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-76937d46-6362-4861-9221-51617696b2fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-76937d46-6362-4861-9221-51617696b2fc admin admin] Request method failure captured: Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Host: 10.222.0.33 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4P4rr4eGryXakjfYm2EYgoJkyQ3SoJmbpR2jnONiWpDYM8yE0_JERfZwa7JVVdTccJcdveLgSUshwEutCYgT6Rj-70lDBJgRUKUpBXFnBN-W_i47g5DBFQy4hul7KEypSyEpV_w5yHapFqYHK1lyldozGR3L5TCT-neVpJm9W9Hs2uk Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Role: admin,reader,member Jul 27 08:58:20.614119 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Roles: admin,reader,member Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User: admin Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: method: > Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: exception: Flavor 84 could not be found. Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: action_args: {'id': '84'} Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:20.616582 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:20.618594 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:20.620681 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-76937d46-6362-4861-9221-51617696b2fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:20.622583 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-76937d46-6362-4861-9221-51617696b2fc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011883 Jul 27 08:58:20.622583 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Jul 27 08:58:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 08:58:21.590191 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-eeb258db-276e-4e42-882e-2b21d52ac459 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:21.591192 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-eeb258db-276e-4e42-882e-2b21d52ac459 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 27 08:58:21.591583 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:22.112971 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-c7ae1561-e515-453a-979f-f75daccb1c2f admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:22.119223 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.wsgi [None req-c7ae1561-e515-453a-979f-f75daccb1c2f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-c7ae1561-e515-453a-979f-f75daccb1c2f admin admin] Request method failure captured: Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept: application/json Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Accept-Encoding: gzip, deflate Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Connection: keep-alive Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Content-Length: 0 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Host: 10.222.0.33 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Openstack-System-Scope: None Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: User-Agent: python-novaclient Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Auth-Token: gAAAAABi4P4tyivmx3c74M6bCp0Gajn3Ynxg2fSxuLSvCMQNz4UULAn3Fqkr8Dca3IE3GAhK38eSC09-VwxGHUqYDNeI8EPCKDLCEjneOIACGPhRGJ3Fjg1U64jhPIVGqZXbT8R_iFWvez6o79WSyuaTF63Mj6TQEpPqqnQKQ2YVaDhYYeWx1LE Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Id: None Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Domain-Name: None Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Identity-Status: Confirmed Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Is-Admin-Project: True Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Id: default Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Domain-Name: Default Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Project-Name: admin Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Role: admin,reader,member Jul 27 08:58:22.120770 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Roles: admin,reader,member Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant: admin Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-Tenant-Name: admin Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User: admin Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Id: default Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Domain-Name: Default Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: X-User-Name: admin Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: method: > Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: exception: Flavor 451 could not be found. Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: action_args: {'id': '451'} Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:22.122415 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:22.123504 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.124883 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-c7ae1561-e515-453a-979f-f75daccb1c2f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:22.126120 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-c7ae1561-e515-453a-979f-f75daccb1c2f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393613 Jul 27 08:58:22.126120 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 08:58:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:22.131978 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-b8fcde35-936d-460b-bdbb-1126533a7f8f admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:22.147540 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-b8fcde35-936d-460b-bdbb-1126533a7f8f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019132 Jul 27 08:58:22.148183 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:22.157975 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:22.172662 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018192 Jul 27 08:58:22.173190 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Jul 27 08:58:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:58:22.182935 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-ff4ce354-90aa-43f3-988f-09762d212094 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:22.188288 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-ff4ce354-90aa-43f3-988f-09762d212094 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-ff4ce354-90aa-43f3-988f-09762d212094 admin admin] Request method failure captured: Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept: application/json Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Connection: keep-alive Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Content-Length: 0 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Host: 10.222.0.33 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi4P4tyivmx3c74M6bCp0Gajn3Ynxg2fSxuLSvCMQNz4UULAn3Fqkr8Dca3IE3GAhK38eSC09-VwxGHUqYDNeI8EPCKDLCEjneOIACGPhRGJ3Fjg1U64jhPIVGqZXbT8R_iFWvez6o79WSyuaTF63Mj6TQEpPqqnQKQ2YVaDhYYeWx1LE Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Role: admin,reader,member Jul 27 08:58:22.189776 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Roles: admin,reader,member Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eee394e6f3c64d5cbb064a87d0300288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eee394e6f3c64d5cbb064a87d0300288"}]}] Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant: admin Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Id: eee394e6f3c64d5cbb064a87d0300288 Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User: admin Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Id: 21ba0883f3d7488eaf195f83a5b875dd Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: X-User-Name: admin Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: method: > Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: exception: Flavor 451 could not be found. Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: action_args: {'id': '451'} Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:58:22.191355 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:22.192380 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Jul 27 08:58:22.193650 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-ff4ce354-90aa-43f3-988f-09762d212094 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:58:22.194955 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-ff4ce354-90aa-43f3-988f-09762d212094 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012236 Jul 27 08:58:22.194955 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 08:58:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 08:58:23.159602 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:23.160692 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 27 08:58:23.161091 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:23.714228 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-cbcfc97e-7d43-4dc7-90dc-8c171615aa82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:58:23.733616 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-cbcfc97e-7d43-4dc7-90dc-8c171615aa82 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.432449 Jul 27 08:58:23.734160 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Jul 27 08:58:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:58:24.698300 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:24.699305 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 27 08:58:24.699709 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:25.228138 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-c527e01c-8e88-47e1-b531-ac0d8623d73a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:58:25.247106 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-c527e01c-8e88-47e1-b531-ac0d8623d73a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412713 Jul 27 08:58:25.247733 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Jul 27 08:58:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:58:26.218193 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:26.219198 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 27 08:58:26.219604 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:26.755855 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-9a712310-f550-409c-8c1d-fbb654f745c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:58:26.775526 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-9a712310-f550-409c-8c1d-fbb654f745c0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.418960 Jul 27 08:58:26.776094 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Jul 27 08:58:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:58:27.734638 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:27.735638 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 27 08:58:27.736061 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:28.261387 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-5144f49d-9f9a-42bf-a167-9b7d21e50743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:58:28.280777 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-5144f49d-9f9a-42bf-a167-9b7d21e50743 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406774 Jul 27 08:58:28.281332 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Jul 27 08:58:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:58:29.266407 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:29.267414 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 27 08:58:29.267832 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 08:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:58:29.799969 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-cf648dc6-9815-4e33-9f24-4b68757643ee admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:58:29.820370 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-cf648dc6-9815-4e33-9f24-4b68757643ee admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.414121 Jul 27 08:58:29.820897 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Wed Jul 27 08:58:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:59:21.279190 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.280275 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-e5f7c051-99b9-45a1-a621-5b671551917d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 27 08:59:21.280668 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:59:21.291343 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:21.670998 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-3b0e04ea-804e-4b08-90f9-a250abe6cccc admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.691503 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-3b0e04ea-804e-4b08-90f9-a250abe6cccc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404552 Jul 27 08:59:21.693095 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:59:21.716115 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-3fbd7e6d-e394-4f19-8629-8133b3e3ced0 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.719534 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG dbcounter [-] [103380] Writing DB stats nova_api:SELECT=14 {{(pid=103380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:21.725478 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-3fbd7e6d-e394-4f19-8629-8133b3e3ced0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012959 Jul 27 08:59:21.726202 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:21.739953 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-11a14028-df5f-42e4-b1f2-cad67663a355 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.747558 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-11a14028-df5f-42e4-b1f2-cad67663a355 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011228 Jul 27 08:59:21.748108 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:21.759771 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.767501 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Jul 27 08:59:21.769868 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:21.781541 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f4b63b35-380e-431e-a2f0-a94f0bb726c1 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:21.789293 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f4b63b35-380e-431e-a2f0-a94f0bb726c1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011298 Jul 27 08:59:21.789810 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Wed Jul 27 08:59:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:02:41.882729 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:41.883784 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 27 09:02:41.884197 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 09:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:02:42.028079 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=6 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:42.187588 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:42.191335 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:02:42.191335 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 09:02:42.193262 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:42.193707 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:42.194798 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:42.195234 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:42.229712 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-ba0ab14e-4558-47f5-ac43-a849b70fe5c6 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.203141 Jul 27 09:02:42.230293 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 09:02:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:02:43.065784 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:43.066792 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 27 09:02:43.067193 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 09:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:02:43.263861 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:43.266275 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:02:43.266275 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 09:02:43.267555 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:43.268035 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:43.268822 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:43.269249 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:43.289723 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-061e8140-79f2-4aa3-8b5c-880ade5ca696 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081438 Jul 27 09:02:43.290231 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 09:02:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:02:54.536215 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:54.537211 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 27 09:02:54.537601 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 09:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:02:54.680978 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell0:SELECT=4 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:54.681694 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell1:SELECT=4 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:54.682306 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=8 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:54.738425 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:54.740830 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:02:54.740830 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 09:02:54.742033 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:54.742493 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:54.743266 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:54.743687 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:54.768746 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-cf747d66-5065-4048-a657-b55188c06ce3 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092146 Jul 27 09:02:54.769925 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 09:02:54 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:02:55.602745 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: DEBUG nova.api.openstack.wsgi [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] Calling method '>' {{(pid=103380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:55.603775 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: INFO nova.api.openstack.requestlog [None req-17b33bb1-4f1f-4e4d-bf8c-a2e7a68cc7d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 27 09:02:55.604179 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: [pid: 103380|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Jul 27 09:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:02:55.797918 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:02:55.800377 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:02:55.800377 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Jul 27 09:02:55.801568 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:55.802015 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:55.802835 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:02:55.803267 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:02:55.824756 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-23b4731c-bcbb-47a1-a21b-18b39e2c3fd5 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079504 Jul 27 09:02:55.825242 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Jul 27 09:02:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:03:52.866601 dv-cinder-797608-64-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 09:03:52.867385 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: Wed Jul 27 09:03:52 2022 - graceful shutdown triggered... Jul 27 09:03:52.867873 dv-cinder-797608-64-iscsi devstack@n-api.service[103381]: Gracefully killing worker 2 (pid: 103381)... Jul 27 09:03:52.868458 dv-cinder-797608-64-iscsi devstack@n-api.service[103380]: Gracefully killing worker 1 (pid: 103380)... Jul 27 09:03:53.868075 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: worker 1 buried after 1 seconds Jul 27 09:03:53.868581 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: worker 2 buried after 1 seconds Jul 27 09:03:53.868581 dv-cinder-797608-64-iscsi devstack@n-api.service[103379]: goodbye to uWSGI. Jul 27 09:03:53.869648 dv-cinder-797608-64-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 09:03:53.870196 dv-cinder-797608-64-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 09:03:53.873107 dv-cinder-797608-64-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 09:03:53.883859 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 09:03:53 2022] *** Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: nodename: dv-cinder-797608-64-iscsi Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: machine: x86_64 Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: clock source: unix Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: pcre jit disabled Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: detected number of CPU cores: 4 Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: current working directory: / Jul 27 09:03:53.886035 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: detected binary path: /usr/bin/uwsgi-core Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: your processes number limit is 47680 Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: your memory page size is 4096 bytes Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: detected max file descriptor number: 2048 Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: lock engine: pthread robust mutexes Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: thunder lock: enabled Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 09:03:53.886794 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 09:03:53.927241 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: Python main interpreter initialized at 0x5577412d89c0 Jul 27 09:03:53.927241 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: python threads support enabled Jul 27 09:03:53.927241 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: your server socket listen backlog is limited to 100 connections Jul 27 09:03:53.927241 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: your mercy for graceful operations on workers is 90 seconds Jul 27 09:03:53.927668 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 09:03:53.927668 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: *** Operational MODE: preforking *** Jul 27 09:03:53.928177 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: *** uWSGI is running in multiple interpreter mode *** Jul 27 09:03:53.928177 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: spawned uWSGI master process (pid: 117902) Jul 27 09:03:53.928195 dv-cinder-797608-64-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 09:03:53.929564 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: spawned uWSGI worker 1 (pid: 117922, cores: 1) Jul 27 09:03:53.929918 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: spawned uWSGI worker 2 (pid: 117923, cores: 1) Jul 27 09:03:53.930274 dv-cinder-797608-64-iscsi devstack@n-api.service[117902]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 09:03:54.594097 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 09:03:54.606756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 09:03:55.737762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 09:03:55.737762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: from cryptography.utils import int_from_bytes Jul 27 09:03:55.738387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 09:03:55.738387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: from cryptography.utils import int_from_bytes Jul 27 09:03:55.770865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 09:03:55.770865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: from cryptography.utils import int_from_bytes Jul 27 09:03:55.771471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 09:03:55.771471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: from cryptography.utils import int_from_bytes Jul 27 09:03:58.165139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 09:03:58.166072 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 09:03:58.166644 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 09:03:58.166991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 09:03:58.167245 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 09:03:58.167636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.167995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.168318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.168636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.168971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.169282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.169604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.169928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.170258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.170520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.170831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.171153 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-64-iscsi {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.171473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.171988 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.172304 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.172624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.172928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.173248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.173555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.174060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.174873 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.175180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.175590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.175979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.176297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.176626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.176931 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.177250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.177575 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.177885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.178291 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-64-iscsi {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.178614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.178927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.179239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.179661 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.180013 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.180324 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.180644 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.180966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.181275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.181587 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.181929 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.182221 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.182554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.182840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.183148 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.183459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.183800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.184115 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.184413 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.184661 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.184968 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.185287 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.185606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.185935 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.186182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.186432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.186749 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.187067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.187373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.187680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.188019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.188327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.188629 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.188932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.189233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.189536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.189853 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.190750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.191070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.191375 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.191693 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.192151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.192403 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.192710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.193050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.193366 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.193671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.193987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.194308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.194612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.194914 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.195217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.195532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.195877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.196185 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.196428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.196745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.197041 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.197349 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.197656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.197960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.198261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.198566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.198869 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.199175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.199479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.199799 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.200178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.200409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.200736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.201047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.201352 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.201679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.201998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.202305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.202608 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.202912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.203217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.203535 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.203865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.204299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.204629 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.204935 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.205246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.205554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.206422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.206721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.207058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.207332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.207635 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.208029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.208284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.208606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.208886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.209198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.209485 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.209785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.210085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.210385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.210680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.210998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.211319 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.211626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.211957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.212262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.212578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.212917 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.213245 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.213586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.213896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.214227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.214553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.214869 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.215177 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.215490 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.215843 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.216149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.216462 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.216771 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.217088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.217403 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.217729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.218043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.218357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.218671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.218980 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.219297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.219627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.219968 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.220278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.220620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.220965 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.221318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.221645 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.221969 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.222277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.222586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.222892 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.223213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.223544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.223878 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.224198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.224510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.224821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.225132 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.225443 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.225756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.226091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.226408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.226720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.226839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 09:03:58.227246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 09:03:58.227327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.227327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.227585 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 09:03:58.227694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.227903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 09:03:58.228020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.228173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 09:03:58.228281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.228551 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.228652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.228855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.228965 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.229159 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.229261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.229470 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.229578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.229773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.229881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.230094 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.230210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.230421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.230520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.230722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.230830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.231053 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.231165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.231338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.231492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.231654 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.231854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.232006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-64-iscsi {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.232164 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.232309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.232459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.232611 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.232755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.232906 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.233075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.233221 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.233377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.233521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.233671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.233829 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.233981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.234132 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.234288 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.234432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.234631 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.234799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.234981 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.235134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.235286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.235442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.235693 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.235881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.236036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.236203 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.236348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.236500 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.236662 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.236807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.236962 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.237117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.237269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.237414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.237568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.237728 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.237883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.238028 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.238180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.238334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-64-iscsi {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.238480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.238647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.238821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.238988 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.239141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.239299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.239444 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.239588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.239730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.239909 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.240789 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.240946 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.241115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.241264 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.241417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.241572 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.241733 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.241879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.242034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.242179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.242476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.242626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.242782 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.242927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.243070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.243222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.243365 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.243524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.243679 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.243849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.244006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.244170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.244862 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.245033 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.245188 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.245342 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.245495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.245640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.245810 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.246058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.246216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.246380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.246534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.246679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.246832 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.246990 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.247136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.247280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.247431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.247587 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.247819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.247986 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.248131 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.248287 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.248446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.248607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.248758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.248913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.249059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.249212 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.249356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.249506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.249651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.249807 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.249952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.249952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.250259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.250904 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.251085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.251329 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.251478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.251800 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.251966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.252120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.252282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.252462 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.253275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.253426 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.253583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.253726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.253880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.254024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.254167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.254167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.254460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.254460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.254756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.254908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.255059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.255211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.255356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.255356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.255727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.255932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.256079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.256079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.256367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.256367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.256662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.256814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.257572 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.257729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.257874 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.257874 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.258186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.258186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.258468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.258612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.258754 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.259058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.259211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.259211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.259493 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.259636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.259800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.259969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.260141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.260293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.260438 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.261331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.261584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.261750 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.261904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.262049 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.262200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.262345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.262506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.262661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.262805 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.262959 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.263103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.263430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.263599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.263762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.263914 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.264070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.264225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.264446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.264612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.264760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.264910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.265063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.265218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.265362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.265520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.265665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.265818 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.266045 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.266214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.266378 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.266524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.266668 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.266820 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.266972 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.267128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.267301 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.267451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.267451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.267785 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.267951 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.268096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.268096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.268477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.268477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.268774 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.268774 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.269167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.269337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.269483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.269483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.269768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.269914 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.270065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.270217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.270362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.270505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.270659 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.270811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.271442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.271625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.271912 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.272079 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.272237 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.272390 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.272543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.272688 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.272831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.272992 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.273139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.273139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.273592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.273745 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.273889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.274052 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.274207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.274352 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.274505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.274807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.274952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.275106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.275252 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.275403 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.275555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.275698 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.275933 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.276081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.276238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.276382 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.276525 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.276674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.276834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.276834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.277127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 09:03:58.277280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.277440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.277601 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.277769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.277930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278249 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278550 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.278869 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279596 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.279831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.280136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.280305 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.280458 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.280617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.280898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.281093 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.281647 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.281817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282564 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.282885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.283316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.283465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.284401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.284575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.284742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.284902 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285054 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285204 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285683 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.285991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286589 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286747 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.286906 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287452 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287799 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.287969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.288137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.288296 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.288447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289294 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289526 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289677 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289800 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.289938 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290746 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.290876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.291006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.291149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.291288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.291842 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.291982 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.292872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293018 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293554 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293829 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.293957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294195 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294307 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294777 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.294777 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.295908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296680 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296818 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.296948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.297826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298472 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298608 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298608 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.298873 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299140 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299270 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299270 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.299822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.300798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.300798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.300798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.301189 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.301327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.301466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.301995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.301995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302893 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.302893 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.303676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304086 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304486 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.304880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305938 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.305938 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306583 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306714 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306714 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.306966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307623 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.307800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308135 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308525 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308654 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308654 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.308959 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309097 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309640 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309847 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.309847 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310113 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310244 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310244 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310685 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310685 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.310949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.311086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.311086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.311342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.311479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.311620 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312416 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.312893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313024 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313574 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313574 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.313948 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.314762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.315529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316319 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.316866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317538 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317676 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.317814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.318981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319557 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319976 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.319976 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.320941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.321077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.321281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.321449 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.321591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322204 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322504 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.322788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323419 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323557 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323737 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.323910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.324058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.324335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.324476 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.324702 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.324846 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325199 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325629 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.325999 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.326133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.326339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.326592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.326744 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.326883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.327105 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.327256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.327509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.327652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.327853 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.328058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.328194 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.328426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.328560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.328745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329001 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329359 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.329929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.330139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.330365 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.330501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.330772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.330946 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.331083 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.331402 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.331538 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.331703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.331941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.332450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.332587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.332718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.332718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.333877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334596 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.334854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.335108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.335250 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.335428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.335613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.335787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.336063 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.336205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.336375 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.336618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.336761 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.337997 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.338136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.338282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.338471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.338615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.338882 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339056 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339535 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.339885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.340669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.340818 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.340958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.341886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.342022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.342551 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.342708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.342849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.342981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343630 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.343960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344102 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.344916 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.345125 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.345260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.345441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.345648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.345791 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.346050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.346197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.346936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.347106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.347250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.347446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.347595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.347769 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348056 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348208 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348554 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348740 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.348997 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.349139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.349362 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.349504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.349689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.349900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.350036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.350308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.350449 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.350604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.350865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351015 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351208 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.351977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.352233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.352866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.353930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.354969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.355225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.355225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.355671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.355819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.355918 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356176 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.356825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357032 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357341 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357445 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357647 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357750 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.357978 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.358933 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.359901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360362 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.360995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.361171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.361286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.361484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.361778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.361928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362029 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362515 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362828 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.362931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363140 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.363892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364197 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.364814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365021 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365444 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365753 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.365960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366434 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366683 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.366879 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.367851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368196 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.368824 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.369951 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370867 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.370984 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371300 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371491 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371596 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371813 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.371924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372132 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372438 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.372982 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373462 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.373949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374699 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.374973 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375173 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375310 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375621 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.375973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376148 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.376928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.377057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.377242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.377362 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378184 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378541 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.378842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379197 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379493 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.379819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380009 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.380920 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381252 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381644 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.381858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.382076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.382190 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.382492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.382648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.382830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.383114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.383218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.383431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.383903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384482 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384752 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.384939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.385045 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.385314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.385728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.385903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.386187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.386296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.386501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.386813 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.386934 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.387130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.387444 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.387550 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.387773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388402 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.388992 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.389117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.389347 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.389457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.389661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.389754 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390140 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390640 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.390952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.391047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.391316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.391579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.391683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.391944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392055 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392588 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392697 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.392908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393005 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393300 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393717 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.393926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.394954 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.395911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396121 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396743 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.396859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.397972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398284 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.398908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399014 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399226 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.399978 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400197 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400507 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.400915 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401431 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401530 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.401845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402062 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402373 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402670 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.402982 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403296 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403608 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403706 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.403961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404328 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.404966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405279 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.405898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406215 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.406848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407169 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407469 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.407967 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.408133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.408280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.408434 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.408581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.409242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.409400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.409554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.409708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.409862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410018 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410329 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410793 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.410953 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411263 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.411894 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412040 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412184 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.412863 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413522 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.413844 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414004 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414156 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414635 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.414957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.415134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.415298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.415450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.415616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.415955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416442 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416768 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.416931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417725 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.417879 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418195 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.418993 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419145 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.419945 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420096 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420572 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.420874 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421198 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421359 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.421972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.422926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423093 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.423945 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.424110 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.424263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.425438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.425616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426354 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426513 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426812 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.426966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427427 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.427896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.428834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429305 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429616 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429768 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.429928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430087 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430564 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.430891 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431044 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431201 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431360 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431672 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.431859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432330 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432795 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.432946 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.433097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.434862 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.435111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.435439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.435787 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.436087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.436400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.436714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.437060 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.437371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.437714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.438050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.438369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.438710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.439026 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.439356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.439684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.440060 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.440384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.440710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.441034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.441356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.441678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.441994 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.442315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.442636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.443123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.443777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.444124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.444452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.444776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.445097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.445421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.445766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.446159 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.446383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.446704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.447022 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.447360 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.447691 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.448051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.448400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.448729 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.449053 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.449376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.449698 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.450065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.450392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.450715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.451037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.451363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.451966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.452126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.452421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.452743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.453064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.453492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.454082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.454642 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.455218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.455890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.456530 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.457130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.457712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.458376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.458937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.459657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.460023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.460374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.460726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.461092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.461424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.461756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.462096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.462413 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.462728 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.463049 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.463366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.463679 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.464040 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.464361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.464673 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.464999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.465317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.465864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.466248 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.466652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.466857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.467191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.467516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.467855 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.468190 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.468506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.468819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.469145 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.469463 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.469776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.470088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.470404 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.471078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.471078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.472005 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.472322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.472660 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.472975 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.473289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.473601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.473920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.474236 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.474546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.474859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.475170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.475489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.475820 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.476139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.476453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.476771 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.477081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.477396 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.477759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.478090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.478405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.478719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.479046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.479469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.479820 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.480142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.480466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.480817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.481222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.481715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.482323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.482433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.482989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.483101 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.483348 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.483662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.483998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.484328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.484645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.484963 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.485280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.485600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.485917 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.486234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.486552 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.486893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.487733 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.488072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.488391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.488708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.489027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.489349 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.489700 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.490030 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.490359 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.490684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.491020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.491335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.491654 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.492456 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.492456 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.493090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.493090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.493268 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.493552 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.493988 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.494309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.494635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.494966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.495283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.495947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.495947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.496716 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.496716 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.496928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.497270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.497647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.497986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.498320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.498633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.498944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.499458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.499963 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.500087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.500302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.500613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.500927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.501244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.501554 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.501866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.502176 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.502507 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.503174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO dbcounter [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Registered counter for database nova_api Jul 27 09:03:58.504647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.504647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.504647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.504647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.504647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.505087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.505180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.505473 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.505732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.506438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.506438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.509763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.510405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.510405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.510405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.510405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.510985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.511077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.511394 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.511714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.512055 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.512372 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.512686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.513002 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.513339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.513671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.513983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.514316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.515187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.515187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.515373 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.515569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.515931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.516248 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.516566 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.516879 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.517197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.517515 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.517837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.518182 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.519897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.519897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.519897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.520151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.520450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.523657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 09:03:58.524151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_db.sqlalchemy.engines [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.524422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 09:03:58.530891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writer thread running {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.586749 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO dbcounter [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Registered counter for database nova_api Jul 27 09:03:58.587171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.context [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c62e0045-c296-455f-b1a2-d948df83e410(cell1) {{(pid=117922) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 09:03:58.591270 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:03:58.592882 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:03:58.593675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:03:58.595810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:03:58.598350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO dbcounter [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Registered counter for database nova_cell0 Jul 27 09:03:58.602350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO dbcounter [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Registered counter for database nova_cell1 Jul 27 09:03:58.607730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_db.sqlalchemy.engines [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.609839 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_db.sqlalchemy.engines [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.610749 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_db.sqlalchemy.engines [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.615188 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writer thread running {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.618085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writer thread running {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.619393 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writer thread running {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.671998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.context [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c62e0045-c296-455f-b1a2-d948df83e410(cell1) {{(pid=117923) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 09:03:58.676292 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:03:58.677888 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:03:58.678707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:03:58.680795 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:03:58.682819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO dbcounter [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Registered counter for database nova_cell0 Jul 27 09:03:58.687034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO dbcounter [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Registered counter for database nova_cell1 Jul 27 09:03:58.696697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_db.sqlalchemy.engines [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.697889 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_db.sqlalchemy.engines [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.704753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writer thread running {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.706591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writer thread running {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.766471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO dbcounter [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Registered counter for database nova_cell0 Jul 27 09:03:58.774692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_db.sqlalchemy.engines [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.779178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writer thread running {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:58.865102 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO dbcounter [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Registered counter for database nova_cell0 Jul 27 09:03:58.873355 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_db.sqlalchemy.engines [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 09:03:58.887983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writer thread running {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 09:03:59.105341 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: WARNING keystonemiddleware.auth_token [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 09:03:59.113346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: WARNING keystonemiddleware.auth_token [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 09:03:59.212521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: WARNING keystonemiddleware.auth_token [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 09:03:59.219992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: WARNING keystonemiddleware.auth_token [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 09:03:59.467468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: WARNING keystonemiddleware.auth_token [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 09:03:59.474078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: WARNING keystonemiddleware.auth_token [None req-cb2f6ae9-2820-4b91-af66-1fabd5477299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 09:03:59.480508 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577412d89c0 pid: 117922 (default app) Jul 27 09:03:59.563470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: WARNING keystonemiddleware.auth_token [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 09:03:59.570232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: WARNING keystonemiddleware.auth_token [None req-aecae3f3-8450-44af-bd05-cf8439c121dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 09:03:59.575594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577412d89c0 pid: 117923 (default app) Jul 27 09:04:40.671732 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:40.673307 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:40.674105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:40.675080 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:41.379407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:41.381429 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:41.382933 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:41.386369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:42.410832 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ce93c222-36fb-490f-aaa3-150f52f2e249 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Action: 'create', calling method: .version_select at 0x7f6f95e06940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1192275556", "metadata": {"Type": "work"}}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:43.110693 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-94c61f56-0314-4f62-b48d-b2eb15f06a64 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Action: 'create', calling method: .version_select at 0x7f6f95e06940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1123686442"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:44.223808 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ce93c222-36fb-490f-aaa3-150f52f2e249 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.562628 Jul 27 09:04:44.229614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Jul 27 09:04:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3570 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 09:04:44.247269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-524d8313-a74e-4ee1-86ae-ac6633315434 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Calling method '.version_select at 0x7f6f95c5a790>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:44.466674 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-524d8313-a74e-4ee1-86ae-ac6633315434 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9" status: 200 len: 354 microversion: 2.1 time: 0.223625 Jul 27 09:04:44.471452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-94c61f56-0314-4f62-b48d-b2eb15f06a64 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.099611 Jul 27 09:04:44.475120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1155 bytes} [Wed Jul 27 09:04:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3105 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 09:04:44.476413 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:44 2022] GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:04:44.481546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7a3019be-5e9b-4213-9358-b4f376dd2976 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Calling method '.version_select at 0x7f6f95c5aee0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:44.482919 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-950860a0-dcf2-43d8-8f34-49ca101dbf75 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c5a790>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:44.572381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-950860a0-dcf2-43d8-8f34-49ca101dbf75 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0c5e2f50-5f49-4e3e-8aee-4a8cca1c326b" status: 200 len: 350 microversion: 2.1 time: 0.095512 Jul 27 09:04:44.582846 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:44 2022] GET /compute/v2.1/os-volumes/0c5e2f50-5f49-4e3e-8aee-4a8cca1c326b => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:44.582846 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bbfa620e-b19e-4391-a081-cf4adcd00396 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c5aee0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:44.700590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7a3019be-5e9b-4213-9358-b4f376dd2976 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9" status: 200 len: 354 microversion: 2.1 time: 0.222725 Jul 27 09:04:44.701477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:44 2022] GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:44.722865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3a9953c2-90d6-4be5-8830-ca24430ae0dc tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Calling method '.version_select at 0x7f6f95c745e0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:44.787530 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bbfa620e-b19e-4391-a081-cf4adcd00396 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 200 len: 346 microversion: 2.1 time: 0.213044 Jul 27 09:04:44.789301 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:44 2022] GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:44.802322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-de5b21af-e059-47df-8f26-be5a6a1d175b tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Action: 'create', calling method: .version_select at 0x7f6f95c72550>, body: {"snapshot": {"volume_id": "fb5770e5-2318-4516-b6cc-5f10d8a93ad1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1829750249"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:44.929294 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3a9953c2-90d6-4be5-8830-ca24430ae0dc tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9" status: 202 len: 0 microversion: 2.1 time: 0.210645 Jul 27 09:04:44.930333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:04:44 2022] DELETE /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:04:44.945778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ad7ec346-04e9-42de-a37a-9649389c680e tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Calling method '.version_select at 0x7f6f95c5aca0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:45.209312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ad7ec346-04e9-42de-a37a-9649389c680e tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9" status: 200 len: 353 microversion: 2.1 time: 0.268605 Jul 27 09:04:45.212761 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:44 2022] GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 => generated 353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:45.633825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-de5b21af-e059-47df-8f26-be5a6a1d175b tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.836203 Jul 27 09:04:45.640970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 4/9] 10.222.0.33 () {60 vars in 1162 bytes} [Wed Jul 27 09:04:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:45.650145 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-db491628-e80f-46ac-a145-28bf836689ac tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c5a550>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:45.887358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-db491628-e80f-46ac-a145-28bf836689ac tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 287 microversion: 2.1 time: 0.243333 Jul 27 09:04:45.900916 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 6/10] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:45 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:45.903759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-30ef0de7-9eb2-49e8-8180-a6d0def6e074 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c72e50>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:45.989416 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-30ef0de7-9eb2-49e8-8180-a6d0def6e074 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.091103 Jul 27 09:04:45.990511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 5/11] 10.222.0.33 () {58 vars in 1140 bytes} [Wed Jul 27 09:04:45 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:46.002919 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-65e54c6e-581e-451c-b356-9b8a6664ca82 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c74280>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:46.047550 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-65e54c6e-581e-451c-b356-9b8a6664ca82 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 287 microversion: 2.1 time: 0.049506 Jul 27 09:04:46.050779 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:45 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:46.224055 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e8deecf4-3a41-486a-a381-2fef93c8d642 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Calling method '.version_select at 0x7f6f95c5aaf0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:46.258192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-e8deecf4-3a41-486a-a381-2fef93c8d642 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] HTTP exception thrown: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e8deecf4-3a41-486a-a381-2fef93c8d642 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Request method failure captured: Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 HTTP/1.1 Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-oa6WudGoqcYjXimX9Bayb36wj6fIoDPGi3e4KofofO1QbE-XJcdL4eL029aXmwPS9cutRpLAUrpftRcwPdIkAAWOLGYyoQxm2xMxdB4d0Q0K1A0IbVejUwMhbT4M96GPhqTJltNv3VrxjrX3-9un5HJfMQrLpJkTsFNFP26nZFlU Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: b2552c3d6cf541859c736f417568220d Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesGetTestJSON-257177290 Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:04:46.265160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2552c3d6cf541859c736f417568220d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2552c3d6cf541859c736f417568220d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2552c3d6cf541859c736f417568220d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2552c3d6cf541859c736f417568220d"}]}] Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesGetTestJSON-257177290 Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: b2552c3d6cf541859c736f417568220d Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesGetTestJSON-257177290 Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesGetTestJSON-257177290-project Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: d6cd19e983ae4016947e77a5a0f66d9a Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesGetTestJSON-257177290-project Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '6766cb87-f6fd-4319-9032-dbb3f9f878d9'} Jul 27 09:04:46.312302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. (HTTP 404) (Request-ID: req-050305fc-e8cb-417b-b846-0b61bae28ab9) Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:46.317960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:46.320633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 09:04:46.323358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e8deecf4-3a41-486a-a381-2fef93c8d642 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] Returning 404 to user: Volume 6766cb87-f6fd-4319-9032-dbb3f9f878d9 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e8deecf4-3a41-486a-a381-2fef93c8d642 tempest-VolumesGetTestJSON-257177290 tempest-VolumesGetTestJSON-257177290-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9" status: 404 len: 109 microversion: 2.1 time: 0.048326 Jul 27 09:04:46.326915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:46 2022] GET /compute/v2.1/os-volumes/6766cb87-f6fd-4319-9032-dbb3f9f878d9 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:04:46.411491 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5221ebad-5c46-4f16-b167-e322440b6a9d tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c5a790>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:46.536769 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5221ebad-5c46-4f16-b167-e322440b6a9d tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2e2cdd2c-34ad-4e0f-a934-60240389d7ea" status: 200 len: 350 microversion: 2.1 time: 0.128886 Jul 27 09:04:46.538150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:46 2022] GET /compute/v2.1/os-volumes/2e2cdd2c-34ad-4e0f-a934-60240389d7ea => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:47.063134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-690989ed-f0da-4a65-a9c8-3633f79adfc3 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c72160>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:47.120190 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-690989ed-f0da-4a65-a9c8-3633f79adfc3 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 287 microversion: 2.1 time: 0.061377 Jul 27 09:04:47.121582 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 7/15] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:47 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:48.137457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0e23cd55-24f9-457a-864a-b218bfdb80db tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95e06280>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:48.217646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0e23cd55-24f9-457a-864a-b218bfdb80db tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 287 microversion: 2.1 time: 0.088495 Jul 27 09:04:48.218586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:48 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:49.230899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-56cc0a49-329f-4a78-8f92-d5daef0b2187 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95bde670>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.264967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d4082973-9786-4b13-a52a-074f54466da3 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c74550>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.322477 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-56cc0a49-329f-4a78-8f92-d5daef0b2187 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 288 microversion: 2.1 time: 0.095382 Jul 27 09:04:49.328872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 8/17] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:49.333932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c4fd65fb-a956-4b62-9dae-4d400edbfed6 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c5ac10>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.388432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d4082973-9786-4b13-a52a-074f54466da3 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c23bc3b6-eb36-4aaa-8f23-cf3bbc1c1f39" status: 200 len: 350 microversion: 2.1 time: 0.127242 Jul 27 09:04:49.389012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 10/18] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-volumes/c23bc3b6-eb36-4aaa-8f23-cf3bbc1c1f39 => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:49.401590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f529654e-242d-4ef2-98f4-b9cb17d4a424 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c5adc0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.456222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c4fd65fb-a956-4b62-9dae-4d400edbfed6 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 202 len: 0 microversion: 2.1 time: 0.125895 Jul 27 09:04:49.456809 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 9/19] 10.222.0.33 () {58 vars in 1254 bytes} [Wed Jul 27 09:04:49 2022] DELETE /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:04:49.466105 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e067144c-1f79-4408-b705-96e7982a0282 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95bde4c0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.546201 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e067144c-1f79-4408-b705-96e7982a0282 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 200 len: 287 microversion: 2.1 time: 0.084879 Jul 27 09:04:49.548516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:04:49.717725 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f529654e-242d-4ef2-98f4-b9cb17d4a424 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.319764 Jul 27 09:04:49.720362 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1134 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:04:49.733764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-40c90ede-b246-4282-a180-bd72c615e41a tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95bded30>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:49.926746 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-40c90ede-b246-4282-a180-bd72c615e41a tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.197221 Jul 27 09:04:49.935521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 11/22] 10.222.0.33 () {58 vars in 1149 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:49.941374 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-85a6a50e-e03f-481f-b03b-25fcfa6c19c8 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c740d0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.129136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-85a6a50e-e03f-481f-b03b-25fcfa6c19c8 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.192228 Jul 27 09:04:50.129982 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1134 bytes} [Wed Jul 27 09:04:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:04:50.144281 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b68a893c-ec12-4a08-abbb-41134180b261 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95bde1f0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.341646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b68a893c-ec12-4a08-abbb-41134180b261 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.202443 Jul 27 09:04:50.342253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 12/24] 10.222.0.33 () {58 vars in 1167 bytes} [Wed Jul 27 09:04:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:04:50.356235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1363039e-93b7-4de2-b535-99f46491db1f tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c83c10>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.561870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f1d7530a-00b8-4165-9c5d-14e16d159818 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95beb280>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.629693 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-f1d7530a-00b8-4165-9c5d-14e16d159818 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] HTTP exception thrown: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f1d7530a-00b8-4165-9c5d-14e16d159818 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Request method failure captured: Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b HTTP/1.1 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-pz-HSBMfecohZfQt9bdlUMg8GZIUWwrqL-jqnlR1elDKbDL4gsD6UinjjEmF0tIZzGibi3weZlYNPlDJZYTKOMvN6nGf5ICbe3KAwML06_U6jAJhgIB0lU6oXGd8Qkdg_0GFraERR1J4Wo5Ezqc6IXx_Zi8ycZLYeU9_IVvgSZfo Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:04:50.638376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2880ef3d1bb4b319a39e9eeef0426c3"}]}] Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 4ece305299c64533b743ab0e205f3560 Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '3d302bfd-5b87-422d-9712-ce284362cc4b'} Jul 27 09:04:50.639469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. (HTTP 404) (Request-ID: req-72f968bd-5187-4951-bc16-39442df8c68d) Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.640146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:50.641020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 09:04:50.641857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. Jul 27 09:04:50.642828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:50.645133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f1d7530a-00b8-4165-9c5d-14e16d159818 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Returning 404 to user: Snapshot 3d302bfd-5b87-422d-9712-ce284362cc4b could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:04:50.646518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f1d7530a-00b8-4165-9c5d-14e16d159818 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b" status: 404 len: 111 microversion: 2.1 time: 0.088556 Jul 27 09:04:50.647688 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:04:50 2022] GET /compute/v2.1/os-snapshots/3d302bfd-5b87-422d-9712-ce284362cc4b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:04:50.674966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1363039e-93b7-4de2-b535-99f46491db1f tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.323259 Jul 27 09:04:50.683672 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1170 bytes} [Wed Jul 27 09:04:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:50.686161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6bb3cd41-d19b-41a7-b54a-b40a168f122d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c5ac10>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.693376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-11202fb0-d5db-41de-9256-668b338ca21d tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c83040>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.865809 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6bb3cd41-d19b-41a7-b54a-b40a168f122d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 202 len: 0 microversion: 2.1 time: 0.212613 Jul 27 09:04:50.867151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:04:50 2022] DELETE /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:04:50.887116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e3159030-8336-4de9-a7a6-240f304f4782 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95bde8b0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:50.998469 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-11202fb0-d5db-41de-9256-668b338ca21d tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.308809 Jul 27 09:04:50.999057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 14/28] 10.222.0.33 () {58 vars in 1155 bytes} [Wed Jul 27 09:04:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:04:51.014397 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4ae75f33-4982-459b-88d5-a540adab9d01 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95c5a670>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:51.042919 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e3159030-8336-4de9-a7a6-240f304f4782 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 200 len: 345 microversion: 2.1 time: 0.169825 Jul 27 09:04:51.043139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 15/29] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:50 2022] GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:51.232062 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4ae75f33-4982-459b-88d5-a540adab9d01 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.222710 Jul 27 09:04:51.232655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 15/30] 10.222.0.33 () {58 vars in 1188 bytes} [Wed Jul 27 09:04:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:04:51.245910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a9f47b63-6acd-4019-abd5-90a60e706594 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] Calling method '.version_select at 0x7f6f95bde0d0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:51.517788 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a9f47b63-6acd-4019-abd5-90a60e706594 tempest-VolumesTestJSON-2106851436 tempest-VolumesTestJSON-2106851436-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.276170 Jul 27 09:04:51.518643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1155 bytes} [Wed Jul 27 09:04:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:04:52.057102 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0ee4532-2637-4350-af9c-34098ff4f7f4 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c86af0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:52.114308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-c0ee4532-2637-4350-af9c-34098ff4f7f4 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] HTTP exception thrown: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0ee4532-2637-4350-af9c-34098ff4f7f4 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Request method failure captured: Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 HTTP/1.1 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-pz-HSBMfecohZfQt9bdlUMg8GZIUWwrqL-jqnlR1elDKbDL4gsD6UinjjEmF0tIZzGibi3weZlYNPlDJZYTKOMvN6nGf5ICbe3KAwML06_U6jAJhgIB0lU6oXGd8Qkdg_0GFraERR1J4Wo5Ezqc6IXx_Zi8ycZLYeU9_IVvgSZfo Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:04:52.119011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2880ef3d1bb4b319a39e9eeef0426c3"}]}] Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 4ece305299c64533b743ab0e205f3560 Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'fb5770e5-2318-4516-b6cc-5f10d8a93ad1'} Jul 27 09:04:52.120728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. (HTTP 404) (Request-ID: req-06298953-40e3-4312-9acc-6c51f0885ef4) Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.121313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:52.123292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 09:04:52.124162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0ee4532-2637-4350-af9c-34098ff4f7f4 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Returning 404 to user: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:04:52.127613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c0ee4532-2637-4350-af9c-34098ff4f7f4 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 404 len: 109 microversion: 2.1 time: 0.067230 Jul 27 09:04:52.136172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-341576a9-11a5-4eb0-800b-f34abed23a0d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95bf7160>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:52.140972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 16/32] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:52 2022] GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:04:52.212488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-341576a9-11a5-4eb0-800b-f34abed23a0d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] HTTP exception thrown: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-341576a9-11a5-4eb0-800b-f34abed23a0d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Request method failure captured: Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 HTTP/1.1 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-pz-HSBMfecohZfQt9bdlUMg8GZIUWwrqL-jqnlR1elDKbDL4gsD6UinjjEmF0tIZzGibi3weZlYNPlDJZYTKOMvN6nGf5ICbe3KAwML06_U6jAJhgIB0lU6oXGd8Qkdg_0GFraERR1J4Wo5Ezqc6IXx_Zi8ycZLYeU9_IVvgSZfo Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:04:52.214415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2880ef3d1bb4b319a39e9eeef0426c3"}]}] Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 4ece305299c64533b743ab0e205f3560 Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'fb5770e5-2318-4516-b6cc-5f10d8a93ad1'} Jul 27 09:04:52.215439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. (HTTP 404) (Request-ID: req-9dbfc53d-7485-4e95-b44e-ce76df64970b) Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.216092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:04:52.217206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 09:04:52.218325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-341576a9-11a5-4eb0-800b-f34abed23a0d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Returning 404 to user: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-341576a9-11a5-4eb0-800b-f34abed23a0d tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 404 len: 109 microversion: 2.1 time: 0.083869 Jul 27 09:04:52.219957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 17/33] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:04:52 2022] DELETE /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:04:52.224841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d93b0ba4-bdd0-4b25-a4c2-5e9f14436623 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Calling method '.version_select at 0x7f6f95c83040>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:04:52.275420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-d93b0ba4-bdd0-4b25-a4c2-5e9f14436623 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] HTTP exception thrown: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d93b0ba4-bdd0-4b25-a4c2-5e9f14436623 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Request method failure captured: Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 HTTP/1.1 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-pz-HSBMfecohZfQt9bdlUMg8GZIUWwrqL-jqnlR1elDKbDL4gsD6UinjjEmF0tIZzGibi3weZlYNPlDJZYTKOMvN6nGf5ICbe3KAwML06_U6jAJhgIB0lU6oXGd8Qkdg_0GFraERR1J4Wo5Ezqc6IXx_Zi8ycZLYeU9_IVvgSZfo Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:04:52.277884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2880ef3d1bb4b319a39e9eeef0426c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2880ef3d1bb4b319a39e9eeef0426c3"}]}] Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: a2880ef3d1bb4b319a39e9eeef0426c3 Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1559379399 Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 4ece305299c64533b743ab0e205f3560 Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1559379399-project Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'fb5770e5-2318-4516-b6cc-5f10d8a93ad1'} Jul 27 09:04:52.279020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. (HTTP 404) (Request-ID: req-74a981fd-9274-44ef-83a0-7ab7bcc6c50f) Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.279682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:04:52.280567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 09:04:52.281501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d93b0ba4-bdd0-4b25-a4c2-5e9f14436623 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] Returning 404 to user: Volume fb5770e5-2318-4516-b6cc-5f10d8a93ad1 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d93b0ba4-bdd0-4b25-a4c2-5e9f14436623 tempest-VolumesSnapshotsTestJSON-1559379399 tempest-VolumesSnapshotsTestJSON-1559379399-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1" status: 404 len: 109 microversion: 2.1 time: 0.059237 Jul 27 09:04:52.282426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 17/34] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:04:52 2022] GET /compute/v2.1/os-volumes/fb5770e5-2318-4516-b6cc-5f10d8a93ad1 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:04:56.684214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-357542215", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "networks": [{"uuid": "87ec4288-2bce-495d-8c80-78a4359efdd7"}]}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:56.704636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-38f950a3-f4b3-4084-8549-01cd8191ada6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: .version_select at 0x7f6f95beb3a0>, body: {"keypair": {"name": "tempest-keypair-495678746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLq5OukHxh+dVVIT89p7QsQIfw+79+A96L2nOCnWNLfD0WXg/elRal8u+yQKbX5+vm3lNSxtgHNr06jELTdJoVqYt7s5ii3sJTfvffr975SiJF6XV0p+sroQf8qZuVNwg=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:56.907911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-38f950a3-f4b3-4084-8549-01cd8191ada6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for project cebf61d3bcd54689abcd1334772bfa51. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:04:56.947525 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-38f950a3-f4b3-4084-8549-01cd8191ada6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for user d793017cc53946bf91738acf42a6483c and project cebf61d3bcd54689abcd1334772bfa51. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:04:57.206679 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-38f950a3-f4b3-4084-8549-01cd8191ada6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.090051 Jul 27 09:04:57.208414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 18/35] 10.222.0.33 () {62 vars in 1200 bytes} [Wed Jul 27 09:04:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1097 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 09:04:57.213138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] validate_networks() for [('87ec4288-2bce-495d-8c80-78a4359efdd7', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:04:57.393789 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a88e3256-f2b2-45d8-8575-c3ff6a126ba2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: .version_select at 0x7f6f95354160>, body: {"keypair": {"name": "tempest-keypair-1193852567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLYf/Akp0Ab9WdNmpovjzr/jMrkHJt2DuiK8ZOD4SV8x/22PD7XLfnJQuj6mn0j0N/cgqSoMeggO1sGMG0sWyetvpWSHSM05wDeBhsIj9uABdyRUC3GCDFkkidhnsnueQ=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:04:57.441301 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-a88e3256-f2b2-45d8-8575-c3ff6a126ba2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:04:57.453818 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-a88e3256-f2b2-45d8-8575-c3ff6a126ba2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:04:57.512943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a88e3256-f2b2-45d8-8575-c3ff6a126ba2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303128 Jul 27 09:04:57.517030 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 19/36] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:04:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:00.864041 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1620011718", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:01.057373 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] validate_networks() for [('9ed67304-6657-4210-b748-2a039b60f99b', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:05:01.259874 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:05:01.260657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:05:01.261075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:05:01.261492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:05:01.261908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:05:01.291711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:01.292517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:01.293813 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:01.294263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:01.378500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Getting quotas for project f4f76f9325f24ecfa442596320f8aafd. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:05:01.411633 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Getting quotas for user e18898fe20314d43b1e0942ab87746f9 and project f4f76f9325f24ecfa442596320f8aafd. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:05:01.450268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:05:01.453048 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:05:01.657781 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-eaa5b5eb-97d9-46f3-b02f-c4219db3cf73 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.493200 Jul 27 09:05:01.666156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 5502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:05:01.679779 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-903cb445-a496-4795-b069-8bae4fdade95 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:01.682811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-903cb445-a496-4795-b069-8bae4fdade95 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:02.183090 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-903cb445-a496-4795-b069-8bae4fdade95 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:02.215823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-903cb445-a496-4795-b069-8bae4fdade95 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1214 microversion: 2.1 time: 0.540659 Jul 27 09:05:02.228048 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 19/38] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:01 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1214 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:02.795547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1203051493", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "effe6ca8-c538-478b-abc9-f3d649387e81"}], "security_groups": [{"name": "tempest-securitygroup--1481846775"}], "key_name": "tempest-keypair-1193852567", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:03.276867 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] validate_networks() for [('effe6ca8-c538-478b-abc9-f3d649387e81', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:05:04.422516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:05:04.423246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:05:04.424777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:05:04.425570 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:05:04.426322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:05:04.466111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:04.466619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:04.467487 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:04.468149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:04.575741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:05:04.581126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for user c0b38d0f4f5a4127bc908e07a6629342 and project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:05:04.598283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:05:04.601355 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:05:04.715436 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-481e6500-67c5-406a-8a9d-25dfcfadfb0f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.163335 Jul 27 09:05:04.716219 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:05:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 09:05:04.740053 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:04.748037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:04.806931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:04.807723 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:04.809545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:04.813326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:05.323398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:05.373025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6bef3f3f-92e0-4eed-945a-97252538e1c3 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1218 microversion: 2.1 time: 0.653406 Jul 27 09:05:05.409571 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 21/40] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:04 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1218 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:05.444467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3cdbcd1d-aa27-4ade-a62c-8ecbecc2f566 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:05.457529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3cdbcd1d-aa27-4ade-a62c-8ecbecc2f566 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:05.662931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3cdbcd1d-aa27-4ade-a62c-8ecbecc2f566 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:05.707109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3cdbcd1d-aa27-4ade-a62c-8ecbecc2f566 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1222 microversion: 2.1 time: 0.281836 Jul 27 09:05:05.721610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 22/41] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:05 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:06.027536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:05:06.028088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:05:06.028440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:05:06.028849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:05:06.029250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:05:06.044845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:06.048729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:06.054662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-655716775", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:06.061174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:06.066663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:06.128251 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:05:06.138728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:05:06.176206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:05:06.178000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] validate_networks() for [('9ed67304-6657-4210-b748-2a039b60f99b', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:05:06.179839 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:05:06.337220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3eacf34f-ca47-4d85-a307-d06fc37f8ed3 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.552456 Jul 27 09:05:06.341207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 20/42] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:05:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:05:06.359271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a99c025a-c4ed-4c44-9066-453c23b895e1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:06.361619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a99c025a-c4ed-4c44-9066-453c23b895e1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:06.684161 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a99c025a-c4ed-4c44-9066-453c23b895e1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:06.691787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a99c025a-c4ed-4c44-9066-453c23b895e1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1242 microversion: 2.1 time: 0.345471 Jul 27 09:05:06.698231 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 21/43] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:06 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1242 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:06.715667 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:06.724748 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:06.755645 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:06.756947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:06.759704 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:06.761400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:07.357433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:07.391433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b4384679-359c-4330-9fbd-0e97fb0c9e3d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1272 microversion: 2.1 time: 0.689751 Jul 27 09:05:07.398090 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 22/44] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:06 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1272 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:07.718060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:07.719258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:07.738701 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:07.742611 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:07.747049 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:07.748978 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:08.542148 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:08.589843 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8051822b-2f91-446d-b839-08c7f3cea85d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1246 microversion: 2.1 time: 0.875998 Jul 27 09:05:08.596039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 23/45] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:07 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1246 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:08.636727 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1561172853", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45ea829-27af-4d37-a6b1-f004b13d60c3"}], "security_groups": [{"name": "tempest-securitygroup--1710613767"}], "key_name": "tempest-keypair-495678746", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:09.148252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:05:09.149321 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:05:09.150539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:05:09.151105 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:05:09.151956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:05:09.195415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:09.200019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:09.203180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:09.204200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:09.312594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:05:09.319738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] validate_networks() for [('d45ea829-27af-4d37-a6b1-f004b13d60c3', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:05:09.349277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for user c0b38d0f4f5a4127bc908e07a6629342 and project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:05:09.401939 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:05:09.414785 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:05:09.650986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-28ddb5b2-658c-4028-bb67-ff0115b9ccfa tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.595739 Jul 27 09:05:09.658008 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:05:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 3604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 09:05:09.675684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:09.679605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:09.721630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:09.722325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:09.731384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:09.731384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:10.388406 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:10.407475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d1fc9812-1eff-4d56-9627-2f3c3f561484 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1272 microversion: 2.1 time: 0.744326 Jul 27 09:05:10.425952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 24/47] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:09 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1272 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:10.430994 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:10.449186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:10.467024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:10.474482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:10.475505 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:10.476158 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:10.656270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:10.668071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5a6aec1b-5ee9-4af4-9fb7-5fd8c44d321d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1300 microversion: 2.1 time: 0.240466 Jul 27 09:05:10.672304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:10 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:10.701890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b8ec0c21-1713-4618-bf36-e5881cd31b45 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:10.704557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b8ec0c21-1713-4618-bf36-e5881cd31b45 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:10.885359 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b8ec0c21-1713-4618-bf36-e5881cd31b45 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:10.892961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b8ec0c21-1713-4618-bf36-e5881cd31b45 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1221 microversion: 2.1 time: 0.217343 Jul 27 09:05:10.909622 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 26/49] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:10 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:11.430660 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:11.431434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:11.468392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:11.472232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:11.480878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:11.488913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:13.181838 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:13.207929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3357778f-ea25-4929-8384-522f38a580e4 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 1.781704 Jul 27 09:05:13.208539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 27/50] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:11 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:13.230280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:13.236930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:13.259877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:13.263877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:13.265623 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:13.272979 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.016373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:05:14.017351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:05:14.018010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:05:14.018575 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:05:14.019209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:05:14.043575 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.044578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.049922 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.054619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.136978 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for project cebf61d3bcd54689abcd1334772bfa51. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:05:14.161696 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for user d793017cc53946bf91738acf42a6483c and project cebf61d3bcd54689abcd1334772bfa51. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:05:14.201428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:05:14.204378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:05:14.317996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f33a6114-4d1c-4152-960f-095eedbb940f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.713351 Jul 27 09:05:14.319035 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 24/51] 10.222.0.33 () {62 vars in 1188 bytes} [Wed Jul 27 09:05:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 5718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 09:05:14.324128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:14.330730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:14.363692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.365863 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.366845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.369074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.558455 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:14.570767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a4dc9aff-cc14-4f2c-b751-925d5089914c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1279 microversion: 2.1 time: 0.250288 Jul 27 09:05:14.572979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 25/52] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:14 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:14.599816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:14.600447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:14.628531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.629101 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:14.629966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:14.630586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:15.193878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:15.214614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0040aa89-9d0b-4700-8a2f-8b827ca1d112 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 2.001580 Jul 27 09:05:15.220837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 28/53] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:13 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:15.238112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:15.239579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:15.241721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:15.249036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3232ad09-6f80-4ca0-a059-50ae513fbd0d tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.660190 Jul 27 09:05:15.254065 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 26/54] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:14 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:15.556155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:15.577998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:15.594991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:15.596269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:15.597360 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:15.607511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-767ec680-61bc-4b72-8f54-79b9be8f668e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1281 microversion: 2.20 time: 0.375940 Jul 27 09:05:15.611720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:15.622599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:15.628735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:15.628956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 29/55] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:15 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1281 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:15.632636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:16.062967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:16.070887 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5fe687a8-3a77-4cbe-8fc9-8ddf87c5ffa0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1279 microversion: 2.1 time: 0.480023 Jul 27 09:05:16.087840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 27/56] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:15 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:16.244460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:16.245091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:16.266529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:16.268320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:16.272503 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:16.286610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:16.287213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:16.287923 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:16.299038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:16.299038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:16.299315 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:16.299775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:16.945123 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:16.980259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2283e955-0266-479d-8b55-9f9aa9c4600a tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.697480 Jul 27 09:05:16.989880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 28/57] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:16 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:17.000218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:17.000845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:17.025651 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:17.026492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:17.028182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:17.036384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:17.132155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:17.150591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1fa2d122-b1e3-48ef-b92f-180f5d0afd50 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.910049 Jul 27 09:05:17.154320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 30/58] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:16 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:17.160093 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:17.169757 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:17.192778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:17.202953 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:17.204172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:17.204877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:17.491175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:17.504637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:17.508802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:17.513474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-34b586ea-1576-4e5e-955b-90a48db97f89 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1333 microversion: 2.20 time: 0.522102 Jul 27 09:05:17.514827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 29/59] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:16 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1333 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:17.646920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:17.664290 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1cf6ba13-7a3a-4139-8c6e-220bc6f74d34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1279 microversion: 2.1 time: 0.506133 Jul 27 09:05:17.666523 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 31/60] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:17 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1279 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:18.003225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:18.004353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:18.019394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:18.022027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:18.029656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:18.030972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:18.178934 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:18.179608 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:18.201377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:18.202794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:18.205237 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:18.205705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:18.788780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:18.803527 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6dd95acb-eb84-4aa4-b527-3f840af06377 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.805438 Jul 27 09:05:18.818254 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 30/61] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:17 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:19.262946 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:19.403770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-cd54413a-a10b-4ef4-a6f5-2a3bdc7f8e4e req-30f2ffbf-6f2f-4b1c-8023-85069bc2444a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583fd69f-8c45-4b97-b0af-1f5d703612e6", "tag": "93857c74-06f2-4e64-951c-128509b48787"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:19.455803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-cd54413a-a10b-4ef4-a6f5-2a3bdc7f8e4e req-30f2ffbf-6f2f-4b1c-8023-85069bc2444a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:19.458036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-cd54413a-a10b-4ef4-a6f5-2a3bdc7f8e4e req-30f2ffbf-6f2f-4b1c-8023-85069bc2444a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:19.536786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-cd54413a-a10b-4ef4-a6f5-2a3bdc7f8e4e req-30f2ffbf-6f2f-4b1c-8023-85069bc2444a service nova] Creating event network-changed:93857c74-06f2-4e64-951c-128509b48787 for instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 on hv-cinder-79760 Jul 27 09:05:19.539506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-cd54413a-a10b-4ef4-a6f5-2a3bdc7f8e4e req-30f2ffbf-6f2f-4b1c-8023-85069bc2444a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117922) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 09:05:19.551257 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:19.552140 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:19.558669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:19.559118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:19.594966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.compute.rpcapi [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 09:05:19.600917 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] Releasing lock "compute-rpcapi-router" {{(pid=117922) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 09:05:19.640899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f176ed8d-12c1-427b-9973-acbd21142d3c None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.830307 Jul 27 09:05:19.642833 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 31/62] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:19.666830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:19.674893 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:19.722952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:19.733291 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:19.737964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:19.740147 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:19.973973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:19.982656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-783547a4-f62d-45f5-a250-4fc2d2bc3d19 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 1.808055 Jul 27 09:05:19.983248 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:18 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:20.015901 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:20.021891 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:20.054947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:20.056439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:20.061592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:20.064613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:20.205555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:20.221943 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:20.223466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:20.251589 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-359dd0b3-8324-4ac9-bcc6-0ae4f9c2f677 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1339 microversion: 2.20 time: 0.606938 Jul 27 09:05:20.252236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:19 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1339 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:20.272912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:20.291460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:20.339852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:20.340553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:20.341638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:20.342273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:21.123890 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:21.133256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-eef81877-4530-423b-9e8e-bd751897ffdf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.879943 Jul 27 09:05:21.138271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 33/65] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:20 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:21.155997 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:21.156858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:21.159081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:21.168781 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:21.169365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:21.176835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:21.177477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:21.466174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:21.479888 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1d763572-c5f4-4ab8-811a-cc117feb2b00 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.340180 Jul 27 09:05:21.480608 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 34/66] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:21 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:21.882284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-650c8719-7dba-4504-9370-6c0d1ff32c2f req-c99a31fa-7170-452b-94f7-abab692b704d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7", "tag": "06bad0ac-7b56-44e1-ae95-23369fa7135d"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:21.906578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-650c8719-7dba-4504-9370-6c0d1ff32c2f req-c99a31fa-7170-452b-94f7-abab692b704d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:21.907334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-650c8719-7dba-4504-9370-6c0d1ff32c2f req-c99a31fa-7170-452b-94f7-abab692b704d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:21.941414 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-650c8719-7dba-4504-9370-6c0d1ff32c2f req-c99a31fa-7170-452b-94f7-abab692b704d service nova] Creating event network-changed:06bad0ac-7b56-44e1-ae95-23369fa7135d for instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 on hv-cinder-79760 Jul 27 09:05:21.971383 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-650c8719-7dba-4504-9370-6c0d1ff32c2f req-c99a31fa-7170-452b-94f7-abab692b704d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489287 Jul 27 09:05:21.976453 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 35/67] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:21.991770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:21.995511 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:22.013798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.015720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.018207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.020351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.076531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:22.092217 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-db07e778-688a-4748-bf33-f435032b9c1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 2.099609 Jul 27 09:05:22.095295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 33/68] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:19 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:22.160693 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:22.162007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:22.165059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:22.179553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.188254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.189000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.189449 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.713485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:22.723437 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-62c4d558-e564-4b07-b1f2-9e553efa2265 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.568622 Jul 27 09:05:22.738375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 34/69] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:22 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:22.743674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:22.744743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:22.751106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.752082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.753316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:22.753762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:22.767883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:22.785854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:22.788778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:22.790829 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-71dd8a1f-6734-43ed-85e3-9c6669daca8b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.811173 Jul 27 09:05:22.792025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:21 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:22.991551 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:23.002848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5f5cb328-658f-42c6-ab1a-96043ce8c4b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.262985 Jul 27 09:05:23.003534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 35/71] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:22 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:23.116058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:23.116558 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:23.129344 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.129795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.130594 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.131028 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.421918 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:23.439050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-86dd7030-d58e-4910-b4bb-d69a1e8502b7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.319170 Jul 27 09:05:23.453939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 37/72] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:23 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:23.699200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-803cb8a6-ec03-43f0-8d86-cb7b5c3f1015 req-344672c4-f63d-4f49-a088-46022eb73cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:23.724619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-803cb8a6-ec03-43f0-8d86-cb7b5c3f1015 req-344672c4-f63d-4f49-a088-46022eb73cc3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.725075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-803cb8a6-ec03-43f0-8d86-cb7b5c3f1015 req-344672c4-f63d-4f49-a088-46022eb73cc3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.745884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:23.746532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:23.755099 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-803cb8a6-ec03-43f0-8d86-cb7b5c3f1015 req-344672c4-f63d-4f49-a088-46022eb73cc3 service nova] Creating event network-changed:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:05:23.755851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-803cb8a6-ec03-43f0-8d86-cb7b5c3f1015 req-344672c4-f63d-4f49-a088-46022eb73cc3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 09:05:23.757609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.758586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.758804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.759309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.759722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.760920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.763240 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.763792 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.771630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.compute.rpcapi [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 09:05:23.772541 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] Releasing lock "compute-rpcapi-router" {{(pid=117923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 09:05:23.802540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-40c3b44f-7b91-43c8-a17c-451d77483841 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107698 Jul 27 09:05:23.803790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 36/73] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:23.816999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:23.817755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:23.828178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.828636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:23.829430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:23.829981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.006909 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.023611 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e04920bd-c845-4379-80b3-f1f150c3f1af tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.280033 Jul 27 09:05:24.027909 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 38/74] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:23 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:24.038423 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c09eab3-aefe-4c50-b06c-46dfd39da7a6", "tag": "aa7d95c2-ca1e-412b-b3b6-0de274e1bf29"}, {"name": "network-changed", "server_uuid": "7153fbcc-b11f-4390-abff-969685efd1e5", "tag": "98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:24.062069 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:24.062637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.065005 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.079305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] Creating event network-changed:aa7d95c2-ca1e-412b-b3b6-0de274e1bf29 for instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 on hv-cinder-79760 Jul 27 09:05:24.079305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] Creating event network-changed:98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8 for instance 7153fbcc-b11f-4390-abff-969685efd1e5 on hv-cinder-79760 Jul 27 09:05:24.083665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.085855 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.087336 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eee930a3-55fb-4bce-bfea-bc83ffbb4a92 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.275596 Jul 27 09:05:24.088598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 37/75] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:23 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:05:24.094001 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:24.094787 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:24.105879 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:24.107042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.108034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:24.108266 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-7f12ae18-ef32-4204-8e0e-1ace7878ad3a req-62090cbf-79c1-43bf-8cd7-d89d4438b120 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077702 Jul 27 09:05:24.108971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.109177 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 39/76] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:24.315039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.330235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8a62c8b8-a439-4f83-bf13-a01671ed2f71 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.240288 Jul 27 09:05:24.354542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 38/77] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:24 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:24.457966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=22 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:24.462461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:24.463163 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:24.475060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:24.475461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.479103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:24.480168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:24.487144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=100 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:24.690127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:24.703709 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-930331b6-59fe-465e-beb2-fd0730e2a942 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.243541 Jul 27 09:05:24.705660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 40/78] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:24 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:25.056106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:25.057464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:25.065443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.066164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.067356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.067970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.113892 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:25.115305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:25.126624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.127447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.133289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.133977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.266441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:25.282819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-98010165-d624-4a9f-abd9-7fa00cbb622f tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.231763 Jul 27 09:05:25.283808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 39/79] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:25 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:25.354480 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:25.355098 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:25.363737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.364745 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.365578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.366906 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.376800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:25.403881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:25.405891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:25.410403 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ac54f063-8d19-4392-8f67-c14cfec6ed09 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.300290 Jul 27 09:05:25.411570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 41/80] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:25 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:05:25.563999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=26 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:25.732417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:25.734502 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:25.750566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.751057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.751809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:25.753485 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:25.908326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:25.917447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b6790031-90d4-41ff-aaac-55d560b8fdd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.569400 Jul 27 09:05:25.918710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 40/81] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:25 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:25.993053 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:26.001222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-786450b7-4d31-4f8e-98e3-b4bb8b7a5609 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.278279 Jul 27 09:05:26.002109 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 42/82] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:25 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:26.304658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:26.305391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:26.330989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.330989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:26.330989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.330989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:26.353120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:26.438999 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:26.440736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:26.454437 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.455735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:26.456339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.461398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:26.738517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:26.758085 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-648484d8-fbf2-42a2-af6d-8baf502a0920 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.456864 Jul 27 09:05:26.761711 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 41/83] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:26 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:26.784096 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:26.801722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:26.804621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:26.807001 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e044100c-5fa7-4075-aca5-b3c979827a56 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.375871 Jul 27 09:05:26.809474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 43/84] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:26 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:26.939377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:26.940211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:26.949949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.954749 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:26.956595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:26.957066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.023552 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:27.024193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:27.031172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.031919 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.032871 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.033302 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.214165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:27.229114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-277c50fa-2241-4d41-9266-9db5feebaf7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.294402 Jul 27 09:05:27.229731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 42/85] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:26 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:27.349991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:27.360915 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1266de9f-fc53-4232-80f3-dca1d22e2d2c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.341320 Jul 27 09:05:27.361910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 44/86] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:27 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:27.783369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:27.784096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:27.796757 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.797777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.800068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.800717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.835881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:27.836509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:27.862223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.863063 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:27.863883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:27.864333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:28.040574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:28.049412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8e3ed422-c8dd-4518-88cb-7dd8d15092cb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.270779 Jul 27 09:05:28.056330 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 43/87] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:27 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:28.064873 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:28.079060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:28.080737 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:28.082446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c28d4a2c-f98b-40d2-9331-5bcc8fb452c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.252795 Jul 27 09:05:28.083209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 45/88] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:27 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:28.251087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:28.252106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:28.263137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:28.264794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:28.265602 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:28.266036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:28.382104 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:28.382896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:28.395040 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:28.396425 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:28.400888 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:28.401691 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:29.123095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.132412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-144bd523-8170-4ef4-9f7c-9fc3b5217ba0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.885658 Jul 27 09:05:29.133064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 44/89] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:28 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:29.152645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:29.153567 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:29.165471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:29.166547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:29.168143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:29.176188 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:29.255030 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.267377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9b4c9ef0-8faa-406e-be82-8f79d7731935 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.889204 Jul 27 09:05:29.268850 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 46/90] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:28 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:29.274871 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:29.275803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:29.284274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:29.286655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:29.288134 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:29.288904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:29.500492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.509495 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.511304 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.512449 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e21841bf-86d2-48ed-9a9d-70d9a840c676 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.242387 Jul 27 09:05:29.513189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 47/91] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:29 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:29.529605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:29.538144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4e1383ff-075c-465e-b53c-176ee7cbe092 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.389581 Jul 27 09:05:29.538717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 45/92] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:29 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:30.155396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:30.156386 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:30.158553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=8 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:30.169200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.175844 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.176912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.177502 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.290525 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:30.291151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:30.300604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.301064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.301858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.302354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.377760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.393277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-efe1c9d6-0955-4192-8721-3e6d0a109a7f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.242079 Jul 27 09:05:30.440155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 48/93] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:30 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:30.543109 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:30.543912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:30.564497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.568778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.569747 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.570975 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.588873 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.603000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9bae4c9a-5244-46c3-9911-d1e5db043bfd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.316534 Jul 27 09:05:30.603557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 46/94] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:30 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:30.609568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:30.610639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:30.619027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.619633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.620665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:30.621464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:30.916721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.934097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5db0e7fb-c01f-4421-a5e8-f68939d0d341 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.329260 Jul 27 09:05:30.934895 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 47/95] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:30 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:30.952146 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.965122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.968358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:30.984180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5c3f7bdb-4f6b-429a-9e40-3d72aafb4574 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.445826 Jul 27 09:05:30.996247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 49/96] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:30 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:31.425038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:31.425701 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:31.432541 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.433334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.434290 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.434899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.565254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-0e7c54f0-807f-4b99-95dc-0ac587c54701 req-b9cd1081-8cd2-497e-926d-0eb283e9e159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583fd69f-8c45-4b97-b0af-1f5d703612e6", "name": "network-vif-plugged", "status": "completed", "tag": "93857c74-06f2-4e64-951c-128509b48787"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:31.575925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0e7c54f0-807f-4b99-95dc-0ac587c54701 req-b9cd1081-8cd2-497e-926d-0eb283e9e159 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.576676 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0e7c54f0-807f-4b99-95dc-0ac587c54701 req-b9cd1081-8cd2-497e-926d-0eb283e9e159 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.589460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-0e7c54f0-807f-4b99-95dc-0ac587c54701 req-b9cd1081-8cd2-497e-926d-0eb283e9e159 service nova] Creating event network-vif-plugged:93857c74-06f2-4e64-951c-128509b48787 for instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 on hv-cinder-79760 Jul 27 09:05:31.597315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-0e7c54f0-807f-4b99-95dc-0ac587c54701 req-b9cd1081-8cd2-497e-926d-0eb283e9e159 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193427 Jul 27 09:05:31.597925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 48/97] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:31.626741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:31.627656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:31.635538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.636369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.637453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.638089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.691121 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:31.699095 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-777afd9b-18e8-4148-adb6-f61523c0400e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.279440 Jul 27 09:05:31.703044 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 50/98] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:31 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:31.956898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:31.957963 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:31.969938 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:31.971895 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.979173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-52079b94-e18b-4dc1-aa5b-f30067b4c4b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.356712 Jul 27 09:05:31.982174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:31.983560 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:31.983921 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 49/99] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:31 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:31.984027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:32.012776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:32.013768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:32.025969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:32.032621 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:32.034408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:32.035058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:32.403197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:32.416346 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:32.420288 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:32.426071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-08046906-99a8-450b-b5f3-4e6e39a382b7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.419119 Jul 27 09:05:32.447404 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 50/100] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:32 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:32.465519 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:32.479308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-421ff371-f9c1-46d2-929d-27c574e8f8bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.526886 Jul 27 09:05:32.480209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 51/101] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:31 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:32.726072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:32.728108 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:32.751450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:32.752574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:32.754424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:32.755527 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.004296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:33.005011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:33.008010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.015410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.018362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3c81dde2-1da4-4e00-b80e-dc42496c6375 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.297552 Jul 27 09:05:33.018942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.019080 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 51/102] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:32 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:33.020051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.020490 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.246776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.265872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0a302a11-d116-4211-b52c-9a6b4e4c252e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.265112 Jul 27 09:05:33.268112 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 52/103] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:32 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:33.452777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:33.453470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:33.459514 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.460184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.461126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.461707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.509196 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:33.511363 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:33.518957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.519666 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.520736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.521188 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.724671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.735495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.738856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.741191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2c2225b8-a35d-40ba-986f-028b8a16cf5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.292779 Jul 27 09:05:33.752801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 52/104] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:33 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:05:33.763989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-36883ef0-1aea-444e-a8c3-84108a857de3 req-891cacad-b54d-41c6-96a1-602a5c86c9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7", "name": "network-vif-plugged", "status": "completed", "tag": "06bad0ac-7b56-44e1-ae95-23369fa7135d"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:33.770703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:33.775336 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:33.777013 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-36883ef0-1aea-444e-a8c3-84108a857de3 req-891cacad-b54d-41c6-96a1-602a5c86c9c8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:33.777774 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-36883ef0-1aea-444e-a8c3-84108a857de3 req-891cacad-b54d-41c6-96a1-602a5c86c9c8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:33.792708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-36883ef0-1aea-444e-a8c3-84108a857de3 req-891cacad-b54d-41c6-96a1-602a5c86c9c8 service nova] Creating event network-vif-plugged:06bad0ac-7b56-44e1-ae95-23369fa7135d for instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 on hv-cinder-79760 Jul 27 09:05:33.800578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-36883ef0-1aea-444e-a8c3-84108a857de3 req-891cacad-b54d-41c6-96a1-602a5c86c9c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046327 Jul 27 09:05:33.803278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-35dac9b4-451e-4ce3-9060-5a0fced246bc tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.299137 Jul 27 09:05:33.806749 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 53/105] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:33.808469 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 53/106] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:33 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:34.046311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:34.048546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:34.059864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.060660 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.062645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.063313 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.290310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:34.291309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:34.299322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.307546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.309126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.309809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.416833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:34.428729 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0e5a0c56-8ea9-46a8-b8fb-0eea7c02287f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.391824 Jul 27 09:05:34.429612 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 54/107] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:34 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:34.676748 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:34.685616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a2cdadab-2e70-4739-9b07-0211f6659986 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.399453 Jul 27 09:05:34.699840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 54/108] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:34 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:34.767521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:34.768315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:34.774221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.774690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.775656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.776122 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.825242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:34.825856 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:34.832809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.833510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.834283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:34.834933 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:34.943218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:34.952371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:34.957506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:34.958647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a0a492a0-a470-48f7-981c-351f93be3247 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.195745 Jul 27 09:05:34.959398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 55/109] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:34 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:05:35.019640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:35.028801 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c3743503-7aeb-45bc-a8c2-ff6b0a466f39 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.207254 Jul 27 09:05:35.029385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 55/110] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:34 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:35.450322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:35.450932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:35.456925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.457363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:35.458120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.458548 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:35.585793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:35.593142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f9598272-ebca-4bed-b984-56f9648f9cdf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.146635 Jul 27 09:05:35.593715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 56/111] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:35 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:35.707155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:35.707786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:35.717833 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.718809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:35.719717 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.720200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:35.856023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:35.860326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=100 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:35.865931 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-411dc557-1ba5-45fe-b104-61f584791f32 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.162606 Jul 27 09:05:35.866638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 56/112] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:35 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:35.982514 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:35.983851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:35.990030 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.990489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:35.991427 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:35.991678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.054120 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:36.055111 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:36.062752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.063498 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.064488 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.064959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.143686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:36.152488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:36.154009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:36.155156 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-757bdc0a-6c1b-4e03-8682-9c5d78f87e12 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.176619 Jul 27 09:05:36.155724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 57/113] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:35 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:36.205043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:36.212855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5246c302-7e24-498d-afa8-5c6acb408bfb tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.163125 Jul 27 09:05:36.213513 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 57/114] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:36 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:36.614125 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:36.614706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:36.621333 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.621814 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.622751 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.623184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.765460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:36.773017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-66f0a078-d0e0-40b0-b8dc-253fc14b8be8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.162883 Jul 27 09:05:36.773600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 58/115] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:36 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:36.886894 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:36.887559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:36.894082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.894534 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:36.895301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:36.895738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.022633 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:37.030967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-72db53db-3a9a-4dd9-b2cb-3480d321d058 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.148159 Jul 27 09:05:37.031564 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 58/116] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:36 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:37.178686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:37.179334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:37.185388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.186514 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.187290 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.187730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.191842 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:37.235000 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:37.235611 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:37.241814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.242259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.243031 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.243465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.393205 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:37.401614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e90e2dee-c591-4a35-9dc6-c8117c697781 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1314 microversion: 2.1 time: 0.170879 Jul 27 09:05:37.402527 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 59/117] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:37 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:37.578971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:37.587311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:37.588856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:37.589969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-efeb6e1b-6b03-4ce1-97d1-65337686f3f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.415281 Jul 27 09:05:37.590519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 59/118] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:37 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:37.799567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:37.800819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:37.809280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.809959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.811505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.812660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.858886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-ffb0e1d9-36ad-4c30-8e32-1e8be65a1b39 req-cc688d80-4370-4906-acc3-30275143750d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c09eab3-aefe-4c50-b06c-46dfd39da7a6", "name": "network-vif-plugged", "status": "completed", "tag": "aa7d95c2-ca1e-412b-b3b6-0de274e1bf29"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:37.892575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ffb0e1d9-36ad-4c30-8e32-1e8be65a1b39 req-cc688d80-4370-4906-acc3-30275143750d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:37.894698 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ffb0e1d9-36ad-4c30-8e32-1e8be65a1b39 req-cc688d80-4370-4906-acc3-30275143750d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:37.923084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-ffb0e1d9-36ad-4c30-8e32-1e8be65a1b39 req-cc688d80-4370-4906-acc3-30275143750d service nova] Creating event network-vif-plugged:aa7d95c2-ca1e-412b-b3b6-0de274e1bf29 for instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 on hv-cinder-79760 Jul 27 09:05:37.936955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-ffb0e1d9-36ad-4c30-8e32-1e8be65a1b39 req-cc688d80-4370-4906-acc3-30275143750d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080745 Jul 27 09:05:37.943639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 60/119] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:38.055694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:38.058230 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:38.072617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.073170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.095942 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.097706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.292653 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.302841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-62f6b9b6-89b0-4001-9766-022eb177bb68 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.511564 Jul 27 09:05:38.304174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 60/120] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:37 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:38.325175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.333193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8f5d4f26-65d3-47c0-8482-d3a5468728df tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.283483 Jul 27 09:05:38.346981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 61/121] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:38 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:38.424207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:38.425172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:38.432090 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.432862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.433843 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.434286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.591885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.599441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2e649f7f-cf3e-427a-8ee9-eacaac01f0bf tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1501 microversion: 2.1 time: 0.180376 Jul 27 09:05:38.600049 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 61/122] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:38 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:38.616926 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:38.617804 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:38.624970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.625655 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.626565 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:38.627135 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:38.789837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.800404 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.801903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:38.803022 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7ded205b-7133-4590-88b2-b5319a5cf75a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.190490 Jul 27 09:05:38.803584 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 62/123] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:38 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:39.324645 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:39.325183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:39.331570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.332059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.332835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.333274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.355720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:39.356353 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:39.363108 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.363425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.369059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.369059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.508194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:39.516631 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eedf57da-559e-4ded-8991-05460b389460 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.166032 Jul 27 09:05:39.517207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 63/124] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:39 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:39.543719 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:39.551889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-32b96d1b-830b-4a31-88f3-2ec846b9c5f9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.231163 Jul 27 09:05:39.552464 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 62/125] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:39 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:39.827408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:39.828048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:39.833947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.834389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.835149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.835581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.965130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:39.966604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-2b294237-49c7-4df0-bd29-7b6ce2384015 req-55bdf784-fada-4bd2-9135-e6bd1ae08e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7153fbcc-b11f-4390-abff-969685efd1e5", "name": "network-vif-plugged", "status": "completed", "tag": "98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:39.976221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:39.976755 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2b294237-49c7-4df0-bd29-7b6ce2384015 req-55bdf784-fada-4bd2-9135-e6bd1ae08e4c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:39.977199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2b294237-49c7-4df0-bd29-7b6ce2384015 req-55bdf784-fada-4bd2-9135-e6bd1ae08e4c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:39.977996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:39.979198 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e27de7c2-df92-4a56-b2fe-bf8416c297f7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.155640 Jul 27 09:05:39.979893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 64/126] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:39 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:39.988534 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-2b294237-49c7-4df0-bd29-7b6ce2384015 req-55bdf784-fada-4bd2-9135-e6bd1ae08e4c service nova] Creating event network-vif-plugged:98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8 for instance 7153fbcc-b11f-4390-abff-969685efd1e5 on hv-cinder-79760 Jul 27 09:05:39.995845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-2b294237-49c7-4df0-bd29-7b6ce2384015 req-55bdf784-fada-4bd2-9135-e6bd1ae08e4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Jul 27 09:05:39.996394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 63/127] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:05:40.541034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:40.541776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:40.548065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:40.548511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:40.549276 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:40.549712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:40.573555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:40.574287 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:40.580480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:40.580934 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:40.581708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:40.582144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:40.692049 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:40.701036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-03430dca-9de2-48c0-9ca6-1b83151d05a3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.164127 Jul 27 09:05:40.701843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 65/128] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:40 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:40.719012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:40.726437 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-db58b861-c232-4708-823f-2f0255cb45c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.157261 Jul 27 09:05:40.727028 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 64/129] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:40 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:41.003104 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:41.003716 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:41.010268 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.010758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.011598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.012113 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.145734 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:41.154212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:41.155931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:41.157090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7006e968-e8c8-4da6-afe1-2ca07e15173a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.158023 Jul 27 09:05:41.157831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 66/130] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:40 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:41.722552 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:41.723151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:41.730042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.730485 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.731306 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.731734 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.748988 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:41.749753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:41.756116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.756664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.757502 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:41.758003 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:41.918709 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:41.929607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-094843b3-e5ef-4589-8245-2b70c8871616 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.209986 Jul 27 09:05:41.930660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 65/131] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:41 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:41.996076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:42.004411 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0f8e5e95-7e58-4062-b2c1-7a4f38e1f115 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1368 microversion: 2.1 time: 0.259879 Jul 27 09:05:42.006096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 67/132] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:41 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:42.160245 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ded9fb-1da0-4ba4-8df9-4c4df4ec7378"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:42.163260 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:42.170659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.171077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:42.171884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.172319 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:42.179407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:42.180012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:42.187586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.188100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:42.200787 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.201309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:42.417610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:42.427714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:42.429554 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:42.430835 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-360e7994-e5c0-4a33-b7e5-768d9e34a33b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.255470 Jul 27 09:05:42.437297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 68/133] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:42 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:05:42.954736 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:42.955553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:42.969801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.970207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:42.987014 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:42.987766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.169228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:43.178854 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d8daf8e6-577e-469b-9874-3b7e587730d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1321 microversion: 2.1 time: 0.228002 Jul 27 09:05:43.180115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 69/134] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:42 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:43.185808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:43.187453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:43.194916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.196090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.197192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.198518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.433377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:43.448565 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a7262f97-4d28-4b92-aec3-2ad313b888c0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1559 microversion: 2.1 time: 0.266222 Jul 27 09:05:43.449673 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 70/135] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:43 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1559 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:43.488990 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:43.490601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:43.508023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.509594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.513217 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.513971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.770170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:43.783372 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:43.801487 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:43.804392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-46914069-4932-4785-9e68-4deaf86109a9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.353131 Jul 27 09:05:43.820240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 71/136] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:43 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:43.828221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:43.831939 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:43.834743 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-659f3c59-4ace-45bd-a19e-3ce644e5d131 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "POST /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.678666 Jul 27 09:05:43.835734 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 66/137] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:05:42 2022] POST /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7/os-volume_attachments => generated 194 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:43.841993 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-7eeac711-fa2e-433d-8f03-80a30ff3be84 req-17b45543-b822-43ae-8038-d0a834a0b91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "name": "network-vif-plugged", "status": "completed", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:43.850708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.851176 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.852110 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.856951 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.858450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7eeac711-fa2e-433d-8f03-80a30ff3be84 req-17b45543-b822-43ae-8038-d0a834a0b91d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:43.858970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7eeac711-fa2e-433d-8f03-80a30ff3be84 req-17b45543-b822-43ae-8038-d0a834a0b91d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:43.875943 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-7eeac711-fa2e-433d-8f03-80a30ff3be84 req-17b45543-b822-43ae-8038-d0a834a0b91d service nova] Creating event network-vif-plugged:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:05:43.881972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-7eeac711-fa2e-433d-8f03-80a30ff3be84 req-17b45543-b822-43ae-8038-d0a834a0b91d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044780 Jul 27 09:05:43.883037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 67/138] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:44.096051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f899b5e0-508c-440a-ac6f-13c769aabd36 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274811 Jul 27 09:05:44.096051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 72/139] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:05:43 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:44.207948 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:44.208747 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:44.226339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.226809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.227599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.228391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.594944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:44.605350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1d7fc867-2fad-467d-89ac-9253d06fb10a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1515 microversion: 2.1 time: 0.406750 Jul 27 09:05:44.609442 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 68/140] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:44 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:44.630512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:44.634046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:44.645499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.646280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.651703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.652619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.693816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lazy-loading 'flavor' on Instance uuid 7153fbcc-b11f-4390-abff-969685efd1e5 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:05:44.832885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:44.833504 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:44.844963 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.845594 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.846182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.846616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.939681 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d7721271-03bb-4de1-8409-eddb8a9740b2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5/action" status: 200 len: 32 microversion: 2.1 time: 0.313911 Jul 27 09:05:44.940650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 73/141] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:05:44 2022] POST /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:05:44.963208 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:44.964080 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:44.984222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.984839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:44.987293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:44.987777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:45.195260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:45.202594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:45.211389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5f4bd23b-6fed-43ff-8da6-1064fc12667e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.263644 Jul 27 09:05:45.218547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 74/142] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:44 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:45.524949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:45.535795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:45.537628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:45.538762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ff451fdd-f252-4985-94ba-8487343926be tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1407 microversion: 2.20 time: 0.711197 Jul 27 09:05:45.541397 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 69/143] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:44 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:46.239612 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:46.240412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:46.248463 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:46.249214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:46.250516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:46.251511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:46.562375 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-9ab09542-fb7d-4b5a-9bcd-5d64be003fde req-9430d182-a444-4ef4-b835-10b44b406be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c09eab3-aefe-4c50-b06c-46dfd39da7a6", "tag": "aa7d95c2-ca1e-412b-b3b6-0de274e1bf29"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:46.586903 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-9ab09542-fb7d-4b5a-9bcd-5d64be003fde req-9430d182-a444-4ef4-b835-10b44b406be8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:46.589189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-9ab09542-fb7d-4b5a-9bcd-5d64be003fde req-9430d182-a444-4ef4-b835-10b44b406be8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:46.617898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-9ab09542-fb7d-4b5a-9bcd-5d64be003fde req-9430d182-a444-4ef4-b835-10b44b406be8 service nova] Creating event network-changed:aa7d95c2-ca1e-412b-b3b6-0de274e1bf29 for instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 on hv-cinder-79760 Jul 27 09:05:46.644902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-9ab09542-fb7d-4b5a-9bcd-5d64be003fde req-9430d182-a444-4ef4-b835-10b44b406be8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089998 Jul 27 09:05:46.646465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 70/144] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:05:46.653480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:46.654498 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:46.665166 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:46.666200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:46.667419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:46.668131 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:46.948353 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:46.974593 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-18bef2f0-405b-4d1c-bdf7-dcb6a2d11069 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.740884 Jul 27 09:05:46.980033 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 75/145] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:46 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:47.131043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:47.146523 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:47.149238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:47.151413 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3b746afc-cb1f-4eb4-974d-6050b414265d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1600 microversion: 2.20 time: 0.503415 Jul 27 09:05:47.154622 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 71/146] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:05:46 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1600 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:05:47.179027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:47.179625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:47.193939 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:47.194476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:47.195292 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:47.197258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:47.532268 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-63e63c41-e844-40f1-b36e-785df8264a97 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.358249 Jul 27 09:05:47.534618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 76/147] 10.222.0.33 () {60 vars in 1316 bytes} [Wed Jul 27 09:05:47 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-interface => generated 285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:05:48.000382 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:48.001703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:48.011899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:48.018920 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:48.020052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:48.020735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:48.401623 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:48.422994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c0911faa-f9ad-4211-8e7e-5772b7972ffb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.426953 Jul 27 09:05:48.427555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 72/148] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:47 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:49.451669 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:49.455941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:49.473042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:49.473707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:49.474702 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:49.475347 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:49.528122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-30f9dc91-3fc7-4a29-9aa7-c3edd53149f9 req-77a4dda2-fc8a-4fdb-90fe-507098e8f1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:49.539887 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-30f9dc91-3fc7-4a29-9aa7-c3edd53149f9 req-77a4dda2-fc8a-4fdb-90fe-507098e8f1d1 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:49.540871 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-30f9dc91-3fc7-4a29-9aa7-c3edd53149f9 req-77a4dda2-fc8a-4fdb-90fe-507098e8f1d1 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:49.559415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-30f9dc91-3fc7-4a29-9aa7-c3edd53149f9 req-77a4dda2-fc8a-4fdb-90fe-507098e8f1d1 service nova] Creating event network-changed:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:05:49.566023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-30f9dc91-3fc7-4a29-9aa7-c3edd53149f9 req-77a4dda2-fc8a-4fdb-90fe-507098e8f1d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042694 Jul 27 09:05:49.571805 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 73/149] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:49.685202 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:49.700142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-dea3a0cb-3d41-4c7b-8a67-301f9fe2734b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.254973 Jul 27 09:05:49.714164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 77/150] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:49 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:50.723379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:50.725097 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:50.735886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:50.736571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:50.737552 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:50.740236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:50.950282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:50.953971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:50.962111 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2447853e-b244-413d-96fb-7dd3c2cff6a8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.243792 Jul 27 09:05:50.972681 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 74/151] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:50 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:51.992258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:51.992866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:52.003340 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:52.003824 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:52.004612 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:52.005313 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:52.159270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:52.167441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7382462a-4f5f-4bd8-8a1f-5634ae7cc47d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.178899 Jul 27 09:05:52.176464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 78/152] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:51 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:53.211425 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:53.218183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:53.234081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=82 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:53.242199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:53.242708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:53.243744 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:53.244239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:53.464609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:53.474588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8fe3843d-c5d7-4c5d-8816-d4c27e8a95a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.277844 Jul 27 09:05:53.475223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 75/153] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:53 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:54.210320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:54.210849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:54.219237 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=90 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:54.223179 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.224298 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.225464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.226180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.263341 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:05:54.368621 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-858b2c47-19b2-4f64-82e0-710e345d4f9e tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 204 len: 0 microversion: 2.1 time: 0.164909 Jul 27 09:05:54.369208 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 79/154] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:05:54 2022] DELETE /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 09:05:54.378518 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:54.379131 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:54.388780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.389561 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.390812 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.391256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.509278 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:54.510975 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:54.518176 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.518905 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.520137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:54.521230 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:54.577553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:54.587596 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e3164d24-a2cf-4d55-9e2b-34c652fa1f9b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1553 microversion: 2.1 time: 0.212939 Jul 27 09:05:54.588396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 76/155] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:54 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:54.694960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:54.703777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7a6d87cc-67d8-4192-91d1-44c4e2138f7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.201744 Jul 27 09:05:54.704330 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 80/156] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:54 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:55.610868 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:55.611654 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:55.618624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:55.619110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:55.619904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:55.620344 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:55.726467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:55.727134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:55.734470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:55.734925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:55.735702 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:55.736168 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:55.771554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:55.780314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-58c287f3-9d76-44c2-b740-657b9545ff75 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1553 microversion: 2.1 time: 0.174012 Jul 27 09:05:55.783028 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 77/157] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:55 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:55.889002 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:55.897200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-10a14987-ced0-4770-b02c-f762691ad509 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.175472 Jul 27 09:05:55.897752 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 81/158] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:55 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:56.805383 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:56.805997 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:56.812933 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:56.813375 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:56.814144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:56.814573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:56.918538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:56.920009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:56.926496 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:56.927039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:56.927932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:56.928363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:57.099309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:57.108023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-21d0426d-4835-45d3-8b39-92983058d8ae tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.193324 Jul 27 09:05:57.108801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 82/159] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:56 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:57.274019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:57.290928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e24198bd-735c-406f-b989-d0878c53ad6b tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1553 microversion: 2.1 time: 0.489331 Jul 27 09:05:57.299901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 78/160] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:56 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1553 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:57.769853 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-29016977-d0f4-4bd0-af9a-eece1573e383 req-aabf1e94-d9d6-44b0-bde8-18718422f1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7", "name": "network-vif-deleted", "tag": "06bad0ac-7b56-44e1-ae95-23369fa7135d"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:05:57.787591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-29016977-d0f4-4bd0-af9a-eece1573e383 req-aabf1e94-d9d6-44b0-bde8-18718422f1bb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:57.788313 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-29016977-d0f4-4bd0-af9a-eece1573e383 req-aabf1e94-d9d6-44b0-bde8-18718422f1bb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:57.801533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-29016977-d0f4-4bd0-af9a-eece1573e383 req-aabf1e94-d9d6-44b0-bde8-18718422f1bb service nova] Creating event network-vif-deleted:06bad0ac-7b56-44e1-ae95-23369fa7135d for instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 on hv-cinder-79760 Jul 27 09:05:57.807672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-29016977-d0f4-4bd0-af9a-eece1573e383 req-aabf1e94-d9d6-44b0-bde8-18718422f1bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042710 Jul 27 09:05:57.813254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 83/161] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:05:58.132850 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:58.134699 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:58.146819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:58.147529 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:58.148634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:58.149660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:58.318678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:58.320119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:58.326981 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:58.335784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:58.335784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:58.335784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:58.336458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:58.346193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7ee48c26-701b-474f-a76a-db0a06b5d1a2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.218755 Jul 27 09:05:58.359998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 79/162] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:58 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:58.399999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:58.401459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:58.402133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lazy-loading 'fault' on Instance uuid c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:05:58.481566 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18898fe20314d43b1e0942ab87746f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f76f9325f24ecfa442596320f8aafd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:58.490429 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8501c353-2165-4657-ad75-31656ffc5eca tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 200 len: 1350 microversion: 2.1 time: 0.181517 Jul 27 09:05:58.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 84/163] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:58 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 1350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:05:59.368373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:59.368839 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:59.376870 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.377441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.378870 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.379448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.514575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:59.515203 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:59.521829 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.522299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.523276 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.523814 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.550089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] HTTP exception thrown: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Request method failure captured: Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 HTTP/1.1 Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-3EKzrDwDBJp1UFeDgkxq0KVrziWZ97usZLYKUQw0Gu7KoPQedJk4ubcTIaifWAKwmxZymL_plXBJ20F3FcjcYjOZ-vX5m4aCnOyzXybn-nBMgq_iXFEkoGRI1BjM-3ZYG-zrJ7mnf6x7R_c2wxkR76KD8pkTyGWeXeVqsFC5QXls Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:05:59.566210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f76f9325f24ecfa442596320f8aafd"}]}] Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: e18898fe20314d43b1e0942ab87746f9 Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.567485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7'} Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:05:59.568366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.569859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.571369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Returning 404 to user: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:05:59.572017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6b57bfb1-d1b7-4a04-80b7-307b86a130b5 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 404 len: 111 microversion: 2.1 time: 0.057866 Jul 27 09:05:59.573173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 85/164] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:59 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:05:59.613314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:05:59.624416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2372491f-040e-4194-ad01-046001cc421e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.260817 Jul 27 09:05:59.625466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 80/165] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:05:59 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:05:59.747445 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:05:59.750812 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:05:59.757318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.757777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.758564 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:05:59.759127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:05:59.778136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] HTTP exception thrown: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Request method failure captured: Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7/os-volume_attachments HTTP/1.1 Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-3EKzrDwDBJp1UFeDgkxq0KVrziWZ97usZLYKUQw0Gu7KoPQedJk4ubcTIaifWAKwmxZymL_plXBJ20F3FcjcYjOZ-vX5m4aCnOyzXybn-nBMgq_iXFEkoGRI1BjM-3ZYG-zrJ7mnf6x7R_c2wxkR76KD8pkTyGWeXeVqsFC5QXls Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:05:59.788619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f76f9325f24ecfa442596320f8aafd"}]}] Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: e18898fe20314d43b1e0942ab87746f9 Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.789780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'server_id': 'c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7'} Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:05:59.790504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:05:59.791556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:05:59.792630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Returning 404 to user: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:05:59.792630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-aff78a5b-a661-4e48-98e3-a09a4bdf3e71 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047850 Jul 27 09:05:59.792630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 86/166] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:05:59 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:00.646400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:00.647568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:00.655104 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:00.655546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:00.656350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:00.656773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:00.815809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:00.824784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cca75b4f-a75a-4489-9327-f3c6344ee31f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.183194 Jul 27 09:06:00.825619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 81/167] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:00 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:01.041540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:01.042063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:01.048708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.049159 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:01.050759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.052031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:01.070539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] HTTP exception thrown: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Request method failure captured: Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 HTTP/1.1 Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-3EKzrDwDBJp1UFeDgkxq0KVrziWZ97usZLYKUQw0Gu7KoPQedJk4ubcTIaifWAKwmxZymL_plXBJ20F3FcjcYjOZ-vX5m4aCnOyzXybn-nBMgq_iXFEkoGRI1BjM-3ZYG-zrJ7mnf6x7R_c2wxkR76KD8pkTyGWeXeVqsFC5QXls Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:06:01.073262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f76f9325f24ecfa442596320f8aafd"}]}] Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: e18898fe20314d43b1e0942ab87746f9 Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.074686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7'} Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:06:01.076019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.077294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.079913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Returning 404 to user: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:06:01.080786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-94c12e91-b9d2-4569-aaef-23197053b849 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 404 len: 111 microversion: 2.1 time: 0.044033 Jul 27 09:06:01.084244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 87/168] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:06:01 2022] DELETE /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:01.089778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:01.090640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] [instance: c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:01.099791 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.100589 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:01.101696 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.102461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:01.119622 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] HTTP exception thrown: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Request method failure captured: Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 HTTP/1.1 Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-3EKzrDwDBJp1UFeDgkxq0KVrziWZ97usZLYKUQw0Gu7KoPQedJk4ubcTIaifWAKwmxZymL_plXBJ20F3FcjcYjOZ-vX5m4aCnOyzXybn-nBMgq_iXFEkoGRI1BjM-3ZYG-zrJ7mnf6x7R_c2wxkR76KD8pkTyGWeXeVqsFC5QXls Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:06:01.126656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f76f9325f24ecfa442596320f8aafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f76f9325f24ecfa442596320f8aafd"}]}] Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f4f76f9325f24ecfa442596320f8aafd Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-DeleteServersTestJSON-94359274 Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: e18898fe20314d43b1e0942ab87746f9 Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-DeleteServersTestJSON-94359274-project Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.128408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7'} Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:06:01.129283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. Jul 27 09:06:01.130339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:06:01.133169 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] Returning 404 to user: Instance c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:06:01.134560 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d0853659-72bf-4517-b4a3-186427310665 tempest-DeleteServersTestJSON-94359274 tempest-DeleteServersTestJSON-94359274-project] 10.222.0.33 "GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7" status: 404 len: 111 microversion: 2.1 time: 0.049102 Jul 27 09:06:01.139415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 82/169] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:01 2022] GET /compute/v2.1/servers/c5b41c70-9b55-4ca1-a32b-bdc2ed3488f7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:01.846892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:01.848810 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:01.860957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.861672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:01.864137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:01.864936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:02.186607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:02.194491 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f086b600-6d8b-45ba-9491-b05e6ac8f4f6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.351844 Jul 27 09:06:02.195383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 88/170] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:01 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:03.230162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:03.232256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:03.243908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:03.249053 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:03.252133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:03.252865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:03.515944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:03.524500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4fb2575a-ff81-45b8-8ba5-c644566115e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.309620 Jul 27 09:06:03.539385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 83/171] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:03 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:04.548713 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:04.552586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:04.560566 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:04.561345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:04.563663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:04.564127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:05.070212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:05.089801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c0dd03ca-b068-4f49-84e4-d35feb6193fb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.545012 Jul 27 09:06:05.090465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 89/172] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:04 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:06.113666 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:06.115309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:06.126263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:06.126802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:06.127497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:06.127999 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:06.741230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:06.752296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-536a0fd6-0578-4f83-94fe-3ba47ae0fc39 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.643774 Jul 27 09:06:06.752799 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 84/173] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:06 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:07.775578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:07.777111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:07.789036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:07.789417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:07.795821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:07.796603 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:07.986396 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:07.995382 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1b4eeedc-374b-4148-ac76-8d80d13b7d6b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.224727 Jul 27 09:06:07.995995 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 90/174] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:07 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:08.259619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1532305949", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "networks": [{"uuid": "89f41923-b8a1-4774-8d85-70c6e6a48732"}]}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:06:08.361220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] validate_networks() for [('89f41923-b8a1-4774-8d85-70c6e6a48732', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:06:08.990852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:06:08.991343 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:06:08.991845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:06:08.992713 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:06:08.993193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:06:09.004227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:09.004680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:09.005551 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:09.005992 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:09.018309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:09.019847 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:09.029664 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Getting quotas for project 5b4aed934a6a4fd6a8311bb3fd048d4f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:06:09.034932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:09.035393 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:09.036264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:09.037068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:09.045358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Getting quotas for user 4c3e576003a74e0b9dc7463497d61cd9 and project 5b4aed934a6a4fd6a8311bb3fd048d4f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:06:09.058548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:06:09.061171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:06:09.125721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7f4dc569-0a17-42e9-b4d2-49d7aeb85214 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869988 Jul 27 09:06:09.126367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 85/175] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:06:09.141758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d418c6cb-da46-483b-b18d-5c7ca8bd3b97 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:09.144131 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d418c6cb-da46-483b-b18d-5c7ca8bd3b97 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:09.185419 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:09.196900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8e33e0d1-c0f7-491b-b861-ef7763be9edd tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.183526 Jul 27 09:06:09.198447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 91/176] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:09 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:09.203260 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d418c6cb-da46-483b-b18d-5c7ca8bd3b97 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:09.219003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d418c6cb-da46-483b-b18d-5c7ca8bd3b97 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1219 microversion: 2.1 time: 0.085855 Jul 27 09:06:09.220349 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 86/177] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:09 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:10.219712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:10.220352 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:10.226460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:10.227027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:10.227833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:10.228275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:10.240398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:10.241004 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:10.247943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:10.248140 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:10.248738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:10.249259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:10.249667 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:10.312374 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:10.322012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-49046adc-8d58-4833-9df2-0f0ee70c8ac6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1271 microversion: 2.1 time: 0.085377 Jul 27 09:06:10.322840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 87/178] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:10 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:10.374317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:10.382225 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b8d81b52-57ee-4b27-a95b-d219d85e79de tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.167072 Jul 27 09:06:10.382798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 92/179] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:10 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:11.343318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:11.343988 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:11.350545 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:11.350995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:11.351775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:11.352226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:11.403672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:11.404312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:11.410543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:11.410992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:11.411775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:11.412222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:11.412497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:11.420646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b3dc0cff-9997-4c63-9797-5384dd6ba83d tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1271 microversion: 2.1 time: 0.081214 Jul 27 09:06:11.421229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 88/180] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:11 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:11.547795 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:11.555469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-653da907-6d28-46dc-865a-6869490fe044 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.155594 Jul 27 09:06:11.556077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 93/181] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:11 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:12.442353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:12.442969 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:12.449512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:12.449963 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:12.450733 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:12.451169 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:12.515866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:12.523480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-366356c2-35ab-4149-a898-1702376c5e2b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1271 microversion: 2.1 time: 0.084956 Jul 27 09:06:12.524079 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:12 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:12.576896 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:12.577520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:12.583608 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:12.584150 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:12.585218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:12.585663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:12.721572 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:12.730123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-60f24962-806c-4b10-877b-6b4c9b6d9fb6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.157438 Jul 27 09:06:12.730704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 94/183] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:12 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:13.546105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:13.547330 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:13.554640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:13.555397 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:13.556599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:13.557322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:13.659100 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:13.669623 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7b8a3199-d8b1-41f3-9725-0e2740a17dc8 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1279 microversion: 2.1 time: 0.128074 Jul 27 09:06:13.670198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 90/184] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:13 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:13.752149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:13.752901 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:13.760099 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:13.760625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:13.761560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:13.762096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:13.924601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:13.934794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ae8f3cf7-ee4e-49c0-9ea4-8da3221923d4 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.186491 Jul 27 09:06:13.947776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 95/185] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:13 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:14.690108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:14.690730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:14.698901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:14.699351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:14.700771 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:14.701207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:14.836351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:14.844657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9fdd0e48-602d-4af5-a6fa-f34236e02b2e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.158149 Jul 27 09:06:14.845258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 91/186] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:14 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:14.958535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:14.959147 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:14.965759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:14.966281 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:14.966950 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:14.967379 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:15.098400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:15.106829 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a8abbba9-b248-4619-b7de-69a9fe123016 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.152364 Jul 27 09:06:15.107420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 96/187] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:14 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:15.868477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:15.869096 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:15.876205 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:15.876642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:15.877438 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:15.877857 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:16.005979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:16.013763 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ab0a05ee-7dab-419c-9a97-11975893757e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.149094 Jul 27 09:06:16.014330 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 92/188] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:15 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:16.128812 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:16.129424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:16.135766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:16.136222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:16.136984 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:16.137425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:16.265550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:16.273158 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-02a2ed55-4683-4b23-8820-81d96403c274 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.148144 Jul 27 09:06:16.273737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 97/189] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:16 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:16.811991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-fd368137-27ed-4ce9-8e88-f7c4f39db73e req-466df8ec-5d3c-4fcd-93d7-2a8a27d03788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ed869d-cc3e-4470-baf9-02e2249886d7", "tag": "f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:06:16.833336 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fd368137-27ed-4ce9-8e88-f7c4f39db73e req-466df8ec-5d3c-4fcd-93d7-2a8a27d03788 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:16.833782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fd368137-27ed-4ce9-8e88-f7c4f39db73e req-466df8ec-5d3c-4fcd-93d7-2a8a27d03788 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:16.846472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-fd368137-27ed-4ce9-8e88-f7c4f39db73e req-466df8ec-5d3c-4fcd-93d7-2a8a27d03788 service nova] Creating event network-changed:f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc for instance 92ed869d-cc3e-4470-baf9-02e2249886d7 on hv-cinder-79760 Jul 27 09:06:16.854941 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-fd368137-27ed-4ce9-8e88-f7c4f39db73e req-466df8ec-5d3c-4fcd-93d7-2a8a27d03788 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046700 Jul 27 09:06:16.855831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 93/190] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:06:17.034606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:17.035219 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:17.041205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:17.041651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:17.042408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:17.042841 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:17.178409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:17.186019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-10fa8b62-f09f-4c67-82c3-54f9d1b1558f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.155199 Jul 27 09:06:17.186602 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 98/191] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:17 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:17.296636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:17.297298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:17.303563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:17.304039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:17.304815 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:17.305248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:17.322986 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=100 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:17.588507 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:17.595910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-95516a32-05bf-444c-bffc-7cd60e6dae69 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.305052 Jul 27 09:06:17.596487 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 94/192] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:17 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:18.206403 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:18.207048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:18.213439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:18.213883 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:18.214648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:18.215084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:18.344517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:18.351918 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fd1ad5cb-ce4e-4fad-8314-8563d0f73958 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.149370 Jul 27 09:06:18.352487 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:18 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:18.617366 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:18.618073 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:18.624876 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:18.625618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:18.626390 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:18.626821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:18.760060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:18.769950 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fb4b6367-0767-411c-9798-814d62e61040 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.156363 Jul 27 09:06:18.770531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 95/194] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:18 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:19.373520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:19.374137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:19.380186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:19.380628 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:19.381424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:19.381860 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:19.508509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:19.516780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2cc5bc01-3831-4687-b90a-a8521f39e6ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.147614 Jul 27 09:06:19.517352 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 100/195] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:19 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:19.791286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:19.791967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:19.794386 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:19.795151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=8 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:19.801516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:19.801964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:19.802742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:19.803183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:19.934668 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:19.942138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-03576bf6-192e-4be8-b158-1aa008165305 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.154663 Jul 27 09:06:19.942710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 96/196] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:19 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:20.538723 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:20.540192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:20.547852 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:20.548719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:20.549893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:20.550619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:20.698981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:20.707082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3602f71f-c5ea-4e29-b5e7-c2c8b72e7cc4 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.172899 Jul 27 09:06:20.707685 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 101/197] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:20 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:20.962451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:20.963083 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:20.969507 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:20.969950 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:20.970705 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:20.971138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:21.127194 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:21.148179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-23afe9c9-7ee2-40d7-ac71-3f0c10d0b16b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.189379 Jul 27 09:06:21.150260 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 97/198] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:20 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:21.728143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:21.728717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:21.735483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:21.735969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:21.736755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:21.737200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:21.870943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:21.879841 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5c6edfdd-d082-45cc-b099-d59da02748a9 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.155481 Jul 27 09:06:21.880440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 102/199] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:21 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:22.170051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:22.170855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:22.182021 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:22.182721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:22.184578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:22.185919 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:22.369902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:22.379457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-86f0fc57-efea-422c-9211-a7bd5e64782c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.214171 Jul 27 09:06:22.393071 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 98/200] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:22 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:22.904371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:22.904858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:22.912563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:22.913007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:22.913866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:22.914312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:23.125389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:23.133553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-79d7625e-dc6a-4529-af47-a66473991b88 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.234592 Jul 27 09:06:23.134467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 103/201] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:22 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:23.402843 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:23.403453 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:23.405781 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:23.411636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:23.412116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:23.412892 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:23.413321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:23.555741 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:23.564394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c8c7b80d-c15e-42fa-b8aa-7e469fa70ef2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.165433 Jul 27 09:06:23.565387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 99/202] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:23 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:24.157643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:24.159257 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:24.166514 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:24.167342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:24.170000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:24.170806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:24.380782 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:24.390071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d3ef9e24-09af-4973-bcd4-6b3ca20d756f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.238034 Jul 27 09:06:24.390702 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 104/203] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:24 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:24.587070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:24.588454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:24.595165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:24.595610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:24.596432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:24.596925 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:24.755457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:24.763536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c7d095a6-c32f-4b0a-aedf-6ef3eb4ccf20 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.180223 Jul 27 09:06:24.764151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 100/204] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:24 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:25.410851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:25.411465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:25.413412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:25.419435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:25.419901 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:25.420659 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:25.421087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:25.554996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:25.570003 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b46b54d2-2cd4-425e-af2c-60c694511547 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.162759 Jul 27 09:06:25.570776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 105/205] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:25 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:25.785824 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:25.786581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:25.794056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:25.794506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:25.795418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:25.796021 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:25.947677 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:25.956691 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2bd896fe-516f-4462-ba5f-a7a7b6dc4b11 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.174788 Jul 27 09:06:25.957274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 101/206] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:25 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:26.592331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:26.593107 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:26.599984 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:26.600432 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:26.601210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:26.601645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:26.743227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:26.753030 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d26dd513-9ccd-4051-be1c-7c0801c8b8ac tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.164374 Jul 27 09:06:26.754589 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 106/207] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:26 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:26.961887 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-097f01a2-425d-422c-99f9-9cb651a09965 req-d4e5102f-c7e3-4be0-9aea-b82e039405ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ed869d-cc3e-4470-baf9-02e2249886d7", "name": "network-vif-plugged", "status": "completed", "tag": "f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:06:26.978177 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:26.978928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:26.990070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-097f01a2-425d-422c-99f9-9cb651a09965 req-d4e5102f-c7e3-4be0-9aea-b82e039405ca service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:26.990852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-097f01a2-425d-422c-99f9-9cb651a09965 req-d4e5102f-c7e3-4be0-9aea-b82e039405ca service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:27.001172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:27.002146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:27.004012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:27.004682 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:27.022430 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-097f01a2-425d-422c-99f9-9cb651a09965 req-d4e5102f-c7e3-4be0-9aea-b82e039405ca service nova] Creating event network-vif-plugged:f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc for instance 92ed869d-cc3e-4470-baf9-02e2249886d7 on hv-cinder-79760 Jul 27 09:06:27.029967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-097f01a2-425d-422c-99f9-9cb651a09965 req-d4e5102f-c7e3-4be0-9aea-b82e039405ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071581 Jul 27 09:06:27.030906 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 102/208] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:06:27.162222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:27.170382 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-96ecb32f-23a9-40b2-b19f-89c1e1488680 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.196752 Jul 27 09:06:27.170983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 107/209] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:26 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:27.777160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:27.777160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:27.784880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:27.785528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:27.786476 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:27.787069 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:27.924108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:27.931924 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2f20d6c1-c8e6-4fdc-912c-4e1559a19d7a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.160148 Jul 27 09:06:27.932510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 103/210] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:27 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:28.190955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:28.191603 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:28.202986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:28.202986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:28.202986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:28.202986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:28.352432 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:28.359142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ecf59fac-18b0-4d5c-a478-0170c6024f1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.172052 Jul 27 09:06:28.359715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 108/211] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:28 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:28.953698 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:28.954387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:28.961086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:28.961535 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:28.962314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:28.962752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:29.118780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:29.127160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ce7eb974-3d68-48a6-8822-4d1a91823f86 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.177818 Jul 27 09:06:29.127734 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 104/212] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:28 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:29.380535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:29.381216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:29.388138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:29.388590 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:29.389390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:29.389823 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:29.393804 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:29.525380 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:29.533407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2f5d569a-f976-4f33-9e26-5a43a724558b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.156808 Jul 27 09:06:29.533974 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 109/213] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:29 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:30.149298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:30.149912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:30.157230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:30.157680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:30.158451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:30.158887 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:30.519233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:30.526941 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bb31d625-10cb-4ae1-bb45-7899d5aa8cfb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.381511 Jul 27 09:06:30.528090 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 105/214] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:30 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:30.554337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:30.554965 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:30.561128 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:30.561558 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:30.562320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:30.562747 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:30.695127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:30.702596 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-16061955-a685-438f-bba1-691c04c69cf1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1521 microversion: 2.1 time: 0.152170 Jul 27 09:06:30.703153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 110/215] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:30 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:31.548723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:31.549267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:31.555821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.556267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:31.557030 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.557638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:31.700297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:31.707691 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a8074b9b-b5b5-4bb1-8cb1-1719df535590 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.162832 Jul 27 09:06:31.708457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 106/216] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:31 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:31.723963 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:31.725072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:31.731292 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.731870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:31.732656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.733138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:31.869804 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:31.881930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d9614098-8bc2-480c-ad2a-9e96cfc333e0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1501 microversion: 2.1 time: 0.161620 Jul 27 09:06:31.882526 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 111/217] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:31 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:31.903334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:31.903981 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:31.909947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.910517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:31.911297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:31.911728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:32.098877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:32.109196 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-03afbb32-485e-4746-a13c-d36b1f1faa92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1517 microversion: 2.1 time: 0.210202 Jul 27 09:06:32.110559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 107/218] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:31 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:32.729547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:32.730163 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:32.736267 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:32.736758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:32.737522 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:32.737958 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:32.882628 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:32.891973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-70a91e1b-7754-47d8-9390-c66ee537956f tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.166320 Jul 27 09:06:32.892796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 112/219] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:32 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:33.912803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:33.913599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:33.920703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:33.921221 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:33.922050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:33.922559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:34.061583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:34.069449 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-76310e39-8a80-4e5f-958c-f41ccea4f0ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.160527 Jul 27 09:06:34.070106 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 108/220] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:33 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:35.092025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:35.092638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:35.098605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:35.099054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:35.099855 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:35.100317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:35.233755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:35.241652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9c180cfa-7743-4702-9ee6-8dd42a33fb92 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.154614 Jul 27 09:06:35.242217 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 113/221] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:35 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:36.262735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:36.263340 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:36.270247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:36.271077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:36.272390 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:36.273179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:36.404913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:36.412275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bcf9cae7-393e-48d6-9c8e-e2e110805529 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1319 microversion: 2.1 time: 0.153630 Jul 27 09:06:36.412841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 109/222] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:36 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:37.432777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:37.433911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:37.440097 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:37.440555 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:37.441325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:37.441759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:37.573717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:37.582587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6ca729c8-ddfd-4cbc-86bd-1fc5d494b57b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1508 microversion: 2.1 time: 0.153568 Jul 27 09:06:37.583159 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 114/223] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:37 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:41.088834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:06:41.091880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:41.100262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:41.100742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:41.101536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:41.101975 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:41.131076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lazy-loading 'flavor' on Instance uuid 583fd69f-8c45-4b97-b0af-1f5d703612e6 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:06:41.212634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:41.270238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c88f81b5-0ee7-4d7d-9287-1cc431758ed6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/action" status: 200 len: 32 microversion: 2.1 time: 0.185201 Jul 27 09:06:41.275273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 110/224] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:06:41 2022] POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:06:41.284803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:41.284803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:41.292688 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:41.293383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:41.294952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:41.295475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:41.450170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:41.457806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c1c8deb4-51da-4907-85c7-7cdba7be1092 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.181242 Jul 27 09:06:41.458377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 115/225] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:41 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:42.481034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:42.482023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:42.489963 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:42.490442 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:42.491216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:42.491656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:42.626186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:42.635658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-05f08b00-0096-45a0-a969-79edca97cfcc tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.160285 Jul 27 09:06:42.636922 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 111/226] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:42 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:43.657783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:43.658913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:43.665398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:43.665915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:43.666755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:43.667794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:43.825728 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:43.833504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b29df6c1-5f75-4ec9-bf5b-c46fba530e8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.179425 Jul 27 09:06:43.846846 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 116/227] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:43 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:44.855592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:44.856548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:44.862720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:44.863167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:44.863987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:44.864427 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:45.005238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:45.014356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-28e57276-48af-4018-bbdb-cfc2044b3a46 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.163803 Jul 27 09:06:45.014945 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 112/228] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:44 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:46.036390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:46.037019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:46.043660 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:46.044179 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:46.044970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:46.045408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:46.193246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:46.202229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a4f176c0-ff3e-479b-8dbc-86c3dd046fb5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.169481 Jul 27 09:06:46.203072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 117/229] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:46 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:47.222402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:47.223116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:47.230356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:47.230800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:47.231558 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:47.232011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:47.369808 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:47.377371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bfdb2813-4b8a-45e3-bbe2-f0a556999bd6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.158816 Jul 27 09:06:47.377940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 113/230] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:47 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:48.398371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:48.399057 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:48.405062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:48.405506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:48.406262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:48.406705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:48.541460 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:48.549475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0fc95325-d139-4ea7-ab70-eb402bf28289 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.154933 Jul 27 09:06:48.550048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 118/231] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:48 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:49.570811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:49.571420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:49.578058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:49.578523 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:49.579273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:49.579709 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:49.742298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:49.754842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b4cb4a9b-6bc1-4025-8f17-26dfe76725d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.187816 Jul 27 09:06:49.768891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 114/232] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:49 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:50.775587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:50.776370 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:50.782499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:50.782983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:50.783727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:50.784193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:50.943375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:50.952887 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5dc5a220-3129-4bc5-8236-f3cebf2cd860 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.180995 Jul 27 09:06:50.954050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 119/233] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:50 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:51.974924 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:51.975496 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:51.982518 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:51.983170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:51.983987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:51.984582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:52.149195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:52.157353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6f58a3b0-b19f-49d4-815f-0d5889722b7b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.186730 Jul 27 09:06:52.157978 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 115/234] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:51 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:53.180145 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:53.180836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:53.187709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:53.188283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:53.189163 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:53.189676 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:53.328140 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:53.335604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4d1cd202-e942-45fb-9c50-47f2bc56952f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.159579 Jul 27 09:06:53.336201 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 120/235] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:53 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:54.357109 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:54.357652 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:54.360770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=34 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:54.367086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:54.367647 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:54.368634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:54.369242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:54.634281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:54.642195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-694083bb-e7a2-40f3-8191-fdc0d0895883 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.289265 Jul 27 09:06:54.642760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 116/236] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:54 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:55.428418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1982078827", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:06:55.435815 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=32 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:55.488166 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] validate_networks() for None {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:06:55.663226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:55.663977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:55.670876 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:55.671323 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:55.672138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:55.672632 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:55.819414 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:55.827662 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-04e8ccec-d4f2-479f-b517-2ce96a87fd9f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.168253 Jul 27 09:06:55.828343 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 117/237] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:55 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:06:55.990599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:06:55.991014 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:06:55.991481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:06:55.991929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:06:55.992336 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:06:56.001679 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:56.002117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:56.002905 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:56.003333 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:56.020571 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Getting quotas for project 83666bbaa20f41919849a39b38c8a1e6. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:06:56.024464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Getting quotas for user 1b8915f062c94778b90497966a5f5ae9 and project 83666bbaa20f41919849a39b38c8a1e6. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:06:56.035979 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:06:56.038223 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:06:56.091420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-64e13544-b462-48c0-851f-290e2d267aed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666882 Jul 27 09:06:56.092025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 121/238] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:06:56.102831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3f3839bb-7d6c-4725-b8c6-47cac5b504af tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:56.103446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3f3839bb-7d6c-4725-b8c6-47cac5b504af tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:56.159736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3f3839bb-7d6c-4725-b8c6-47cac5b504af tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:56.167422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3f3839bb-7d6c-4725-b8c6-47cac5b504af tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1215 microversion: 2.1 time: 0.067868 Jul 27 09:06:56.168045 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 118/239] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:56 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:56.850173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:56.850809 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:56.857675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:56.858121 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:56.858914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:56.859346 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:56.997504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:57.004948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-654d055e-1988-4389-b098-74acc2b0a2ad tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.159041 Jul 27 09:06:57.005511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 122/240] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:56 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:57.189067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:57.189794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:57.196758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:57.197129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:57.197928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:57.198368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:57.260214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:57.267935 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0faf79f2-6955-4f12-bc27-ffb84518b439 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1267 microversion: 2.1 time: 0.082759 Jul 27 09:06:57.268538 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 119/241] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:57 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:58.027212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:58.027733 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:58.033789 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:58.034223 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:58.034977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:58.035398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:58.173688 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:58.184004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4c665e61-476e-4e54-ba96-23ee31bfef9b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.161306 Jul 27 09:06:58.184597 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 123/242] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:58 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:58.289683 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:58.290217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:58.297548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:58.298000 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:58.298768 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:58.299206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:58.359459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:58.366910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5c77fd92-3e01-49dd-83b0-e4a61295e5c8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1267 microversion: 2.1 time: 0.081159 Jul 27 09:06:58.367473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 120/243] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:58 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:59.204708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:59.205866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:59.213022 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:59.213962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:59.215088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:59.215363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:59.347227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:59.355328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-377c5038-56ee-4c18-ab8b-3129bcf91070 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.154418 Jul 27 09:06:59.355913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 124/244] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:59 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:06:59.388902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:06:59.389510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:06:59.396132 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:59.396539 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:59.397353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:06:59.397742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:06:59.462852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:06:59.470844 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ff868e4e-8416-4c9b-b171-0a9de88ca23f tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1267 microversion: 2.1 time: 0.086700 Jul 27 09:06:59.471404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 121/245] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:06:59 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:00.376995 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:00.377707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:00.384221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:00.384994 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:00.386207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:00.386638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:00.390557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=91 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:00.495439 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:00.496576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:00.503852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:00.504736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:00.505679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:00.506308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:00.544945 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:00.570495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-097a5ac1-9d86-415c-b5b7-0abd50daa9f5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.188417 Jul 27 09:07:00.572636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 125/246] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:00 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:00.643057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:00.650710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4468f03b-d5d6-47a7-9ed5-736c60ca29d3 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1273 microversion: 2.1 time: 0.159690 Jul 27 09:07:00.651440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 122/247] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:00 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:01.593433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:01.594056 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:01.600478 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:01.600931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:01.601935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:01.602535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:01.675117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:01.675847 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:01.683908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:01.684423 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:01.685215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:01.685658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:01.775553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:01.784017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-16a9fb85-78ce-423f-8876-5d4fc828db8e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.194305 Jul 27 09:07:01.784592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 126/248] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:01 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:01.792830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-f0555ab7-e98f-46ba-b0c8-98b035e72fb1 req-dca6cf40-7821-4291-9c2b-21000b43be25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caef81a7-befd-4872-9041-bb4e13064d39", "tag": "e0f06d57-1deb-457a-a9ab-62542e3e6c14"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:01.802921 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-f0555ab7-e98f-46ba-b0c8-98b035e72fb1 req-dca6cf40-7821-4291-9c2b-21000b43be25 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:01.803646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-f0555ab7-e98f-46ba-b0c8-98b035e72fb1 req-dca6cf40-7821-4291-9c2b-21000b43be25 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:01.816742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-f0555ab7-e98f-46ba-b0c8-98b035e72fb1 req-dca6cf40-7821-4291-9c2b-21000b43be25 service nova] Creating event network-changed:e0f06d57-1deb-457a-a9ab-62542e3e6c14 for instance caef81a7-befd-4872-9041-bb4e13064d39 on hv-cinder-79760 Jul 27 09:07:01.823362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-f0555ab7-e98f-46ba-b0c8-98b035e72fb1 req-dca6cf40-7821-4291-9c2b-21000b43be25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036625 Jul 27 09:07:01.824371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 127/249] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:01.961118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:01.969338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6a3e27f5-61a3-4ea7-b0a7-5264577b298c tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.298859 Jul 27 09:07:01.969912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 123/250] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:01 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:02.806246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:02.806842 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:02.813607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:02.814059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:02.815033 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:02.815696 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:02.959290 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:02.968084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b44e68b1-2676-49eb-859a-74a7a1cb2e09 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.166179 Jul 27 09:07:02.968662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 128/251] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:02 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:02.990636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:02.991247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:02.998328 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:02.998772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:02.999536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:02.999998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:03.127214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:03.135068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-dc08776e-c4db-4ac0-b552-b4c61d34ce0d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.148068 Jul 27 09:07:03.136288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 124/252] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:02 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:03.990087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:03.990710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:03.997686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:03.998391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:03.999170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:03.999942 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:04.135606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:04.143368 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f3448a4b-1ebe-4b74-b897-319f93fec64e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.157125 Jul 27 09:07:04.143999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 129/253] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:03 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:04.156354 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:04.156957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:04.163562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:04.164032 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:04.164804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:04.165238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:04.379549 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:04.387860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-24047b67-3f5b-48f4-96fa-47b58a083ab8 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.235351 Jul 27 09:07:04.388431 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 125/254] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:04 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:05.165399 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:05.166051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:05.172006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.172459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:05.173224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.173767 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:05.333929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:05.342990 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0cb24e98-d090-4e64-871f-8f7a0eb78c84 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.182083 Jul 27 09:07:05.343880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 130/255] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:05 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:05.408648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:05.409358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:05.416086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.417085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:05.417846 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.418272 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:05.567087 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:05.577502 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9efb3690-384c-4485-b2f6-a2a774d6cbcd", "device": "/dev/sdb"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:05.578773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1d0da6f8-19cf-415e-ba73-191c86f14528 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.173761 Jul 27 09:07:05.579642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 126/256] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:05 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:05.581324 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:05.587435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.587913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:05.589005 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:05.589650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.011311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:06.031547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:06.083442 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:06.084105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:06.091049 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.091849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.092634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.093475 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.114236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:06.123911 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b4233a33-5fd9-4afc-9ee3-fdb212a8f230 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/ips" status: 200 len: 152 microversion: 2.20 time: 0.044626 Jul 27 09:07:06.125057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 127/257] 10.222.0.33 () {60 vars in 1289 bytes} [Wed Jul 27 09:07:06 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:07:06.367692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:06.368405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:06.375248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:06.381400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.381983 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.382832 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.383236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.443880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-91a87ae3-1780-47ae-ae6f-03b0c84d4d9b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "POST /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871504 Jul 27 09:07:06.446130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 131/258] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:07:05 2022] POST /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:06.600937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:06.602101 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:06.616315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.620173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.622036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:06.624181 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:06.749261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:06.763460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2345af6a-7241-4bfc-b754-b57194cbfe53 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.401324 Jul 27 09:07:06.777625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 128/259] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:06 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:06.835442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:06.843978 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e820a93d-eb0d-4a25-a897-612a090bb9a9 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.247825 Jul 27 09:07:06.844546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 132/260] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:06 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:07.798447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:07.799156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:07.807627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:07.808120 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:07.808901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:07.809335 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:07.866636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:07.867333 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:07.874865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:07.875422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:07.876310 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:07.876976 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:07.977314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:07.999625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3e1c1be5-232d-40a1-810f-e5f332e3ee38 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.204719 Jul 27 09:07:08.000556 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 129/261] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:07 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:08.037957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:08.047762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e3e0c867-77c9-4571-b971-d39bfd3684ac tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.185105 Jul 27 09:07:08.051797 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 133/262] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:07 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:08.099619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-8812ac3d-5cce-489a-9a6d-c269ab80f603 req-11134001-dc86-4e54-bde8-bf1fcd573e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caef81a7-befd-4872-9041-bb4e13064d39", "name": "network-vif-plugged", "status": "completed", "tag": "e0f06d57-1deb-457a-a9ab-62542e3e6c14"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:08.110798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-8812ac3d-5cce-489a-9a6d-c269ab80f603 req-11134001-dc86-4e54-bde8-bf1fcd573e94 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:08.111238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-8812ac3d-5cce-489a-9a6d-c269ab80f603 req-11134001-dc86-4e54-bde8-bf1fcd573e94 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:08.126686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-8812ac3d-5cce-489a-9a6d-c269ab80f603 req-11134001-dc86-4e54-bde8-bf1fcd573e94 service nova] Creating event network-vif-plugged:e0f06d57-1deb-457a-a9ab-62542e3e6c14 for instance caef81a7-befd-4872-9041-bb4e13064d39 on hv-cinder-79760 Jul 27 09:07:08.135008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-8812ac3d-5cce-489a-9a6d-c269ab80f603 req-11134001-dc86-4e54-bde8-bf1fcd573e94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038545 Jul 27 09:07:08.136706 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 130/263] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:09.021578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:09.022191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:09.029281 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.029730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.030495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.030932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.069537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:09.070287 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:09.077834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.078282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.079276 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.079719 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.165461 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:09.174373 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0d0c3469-eaa6-471d-8dc6-9b69fbd557f0 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1503 microversion: 2.1 time: 0.156617 Jul 27 09:07:09.174959 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 134/264] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:09 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:09.195254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5e7d75b-80b8-443e-a0e9-2574f491145a"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:09.197864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:09.204150 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.204605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.205411 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.205906 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.213927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:09.222114 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a4b6be09-3dee-44da-8dd2-81b82659b458 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.156756 Jul 27 09:07:09.222713 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 131/265] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:09 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:09.368937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] HTTP exception thrown: Cannot 'attach_volume' instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 while it is in vm_state rescued Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Request method failure captured: Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/os-volume_attachments HTTP/1.1 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 74 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-7-iJrST1KTh6rFdPReTUtzFOhnJwCqmKmOQ7sjK_SuSrQR6GVqwr2dWXE9kuH7mF3IezmYxX3c8B3q5wGtEib6CE4Dm7DBLIcG6uj4-qq87DlLaa4rM7nHrSKLxh52r_DnQECbWeH3PvguFBSR_cuOwnh_ATMexGSbDnN-9taDo8 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:07:09.371205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91b6498ed874b4cac422867319642bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91b6498ed874b4cac422867319642bb"}]}] Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c0b38d0f4f5a4127bc908e07a6629342 Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {"volumeAttachment": {"volumeId": "b5e7d75b-80b8-443e-a0e9-2574f491145a"}} Jul 27 09:07:09.372709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Cannot 'attach_volume' instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 while it is in vm_state rescued Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'server_id': '583fd69f-8c45-4b97-b0af-1f5d703612e6', 'body': {'volumeAttachment': {'volumeId': 'b5e7d75b-80b8-443e-a0e9-2574f491145a'}}} Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:07:09.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 while it is in vm_state rescued Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:09.374962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 while it is in vm_state rescued Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Returning 409 to user: Cannot 'attach_volume' instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 while it is in vm_state rescued {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e55008fc-0a52-4caf-ad79-420952e2f5da tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.181786 Jul 27 09:07:09.376058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 135/266] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:07:09 2022] POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/os-volume_attachments => generated 152 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 09:07:09.383561 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:09.384118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:09.390410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.390851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.391609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.392159 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.466720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ba73be85-3373-4345-a46c-99a117ce0c96 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/action" status: 202 len: 0 microversion: 2.1 time: 0.086771 Jul 27 09:07:09.467386 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 132/267] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:07:09 2022] POST /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:07:09.475338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:09.475995 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:09.482757 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.483225 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.484056 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:09.484491 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:09.616027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:09.623561 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6b92edd5-2358-4436-b423-cde06804035f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1511 microversion: 2.1 time: 0.152132 Jul 27 09:07:09.624143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 136/268] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:09 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:10.237003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:10.237643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:10.242253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:10.242951 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:10.243986 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.245013 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.245788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.246225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.249883 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.250327 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.251094 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.251522 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.268894 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lazy-loading 'flavor' on Instance uuid 20213da7-326f-41bd-b775-0fb7238203e9 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:07:10.381257 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:10.389064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-faee7fd1-042e-473a-ac96-95a8e2a9aab4 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1315 microversion: 2.1 time: 0.150555 Jul 27 09:07:10.389619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 137/269] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:10 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:10.447181 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6f1968f6-af63-4856-9f85-658aa1593778 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/action" status: 202 len: 0 microversion: 2.20 time: 0.214849 Jul 27 09:07:10.447884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 133/270] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Jul 27 09:07:10 2022] POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:07:10.456221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:10.456833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:10.462809 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.463766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.464546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.464984 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.605870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:10.613914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:10.615435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:10.616617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-24a9fbdd-f326-4f39-b3af-e31aa4e04c9e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.164261 Jul 27 09:07:10.617171 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 138/271] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:10 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:10.645441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:10.646509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:10.653017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.653774 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.654725 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:10.655327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:10.836809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:10.844827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d49940fe-41cc-4a36-8b9e-25af5da9a49c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1511 microversion: 2.1 time: 0.203723 Jul 27 09:07:10.845387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 134/272] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:10 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:11.410836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:11.411619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:11.418489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.419043 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.419915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.420424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.565888 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:11.574313 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5bc09e0c-56f3-43c0-a1e1-c2c8e91b2234 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1465 microversion: 2.1 time: 0.167340 Jul 27 09:07:11.574903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 139/273] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:11 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:11.622522 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:11.623150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:11.630377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.630885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.631631 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.632091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.642492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:11.643666 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:11.651409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.652367 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.653392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.654049 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.660171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:07:11.757463 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c00ed2c1-2975-4406-864f-eb7c823f9a8d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "DELETE /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 204 len: 0 microversion: 2.1 time: 0.138908 Jul 27 09:07:11.758281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 135/274] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:07:11 2022] DELETE /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:07:11.767567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:11.768298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:11.774305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.774758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.775565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.776187 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.870614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:11.881270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:11.883316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:11.885755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-16bface9-b169-4c8f-9682-f84c5a31440e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.247487 Jul 27 09:07:11.891904 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 140/275] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:11 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:11.892869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:11.893704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:11.903717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.904225 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.905038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:11.905486 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:11.925378 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:11.937901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:11.953420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c8007c6c-ba00-42b7-8b5d-b520f709bb4d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1471 microversion: 2.1 time: 0.189769 Jul 27 09:07:11.954290 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 136/276] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:11 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:12.070205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:12.079586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-824fa122-c0bb-4aad-9291-0b87d71edff3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1511 microversion: 2.1 time: 0.190976 Jul 27 09:07:12.080330 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 141/277] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:11 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:12.640176 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:12.640752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:12.646630 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.647072 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:12.647860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.648295 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:12.671833 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-08f50316-3a7a-450b-a6db-fc1b8856f4a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/ips" status: 200 len: 151 microversion: 2.1 time: 0.035935 Jul 27 09:07:12.672573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 137/278] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:07:12 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:07:12.912438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:12.913046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:12.921175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.921798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:12.922574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.923006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:12.978022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:12.979021 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:12.986826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.987537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:12.988724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:12.989379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:13.175449 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:13.190851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:13.192880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:13.194635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ff6b3074-3f75-4ef3-be83-5a87653ed2af tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.287238 Jul 27 09:07:13.195774 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 142/279] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:12 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:13.202759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:13.203816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:13.211026 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:13.211913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:13.213703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:13.214293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:13.261716 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:13.276017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bf5c38eb-e926-4b6e-b25d-c602f8b93895 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1471 microversion: 2.1 time: 0.302338 Jul 27 09:07:13.277180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 138/280] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:12 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:13.365175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:13.373453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-404c03bc-b017-41d6-93ca-81f6897318e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1511 microversion: 2.1 time: 0.174889 Jul 27 09:07:13.374117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 143/281] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:13 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:14.202261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f4eb991-bf69-4d4f-91d0-7573b49a4ee3"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:14.204715 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:14.211169 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.211612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.212416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.213348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.242222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:14.244080 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:14.252541 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.253017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.253778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.254219 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.413831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:14.422431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:14.423964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:14.425184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f40eea4a-5bb4-4f12-84b8-8a3794a6ef2d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.190586 Jul 27 09:07:14.425742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 144/282] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:14 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:14.430350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:14.430955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:14.446142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.446697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.448271 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.448737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.586170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:14.594275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4cbecc1d-d789-4f29-8ea9-00ba04e8104a tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1471 microversion: 2.1 time: 0.167408 Jul 27 09:07:14.594843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 145/283] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:14 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:14.599264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:14.599979 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:14.606211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.606655 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.607429 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:14.607881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:14.743063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:14.751149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5e5214a7-413d-4be9-b190-7c81358b4f06 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1511 microversion: 2.1 time: 0.155347 Jul 27 09:07:14.751725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 146/284] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:14 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:15.448701 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:15.449311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:15.455876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.456384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.457153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.457587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.598165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:15.607609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:15.609191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:15.610436 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f9961c34-85f4-4d03-9ece-139ba6f17a95 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.166103 Jul 27 09:07:15.611000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 147/285] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:15 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:15.615910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:15.616095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:15.622762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.624085 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.624641 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.625083 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.764611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:15.773893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-254c43c5-0541-422b-9a09-f6c797d495e1 tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1471 microversion: 2.1 time: 0.161892 Jul 27 09:07:15.774638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 148/286] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:15 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:15.779478 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:15.780113 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:15.785837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.786295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.787064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:15.787504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:15.944360 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:15.951971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-342d679f-77b6-4eec-b0ba-1ea127d68c35 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1517 microversion: 2.1 time: 0.176457 Jul 27 09:07:15.952770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 149/287] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:15 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:16.354186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:16.375067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e719879a-d9f7-43a2-80e0-d0e3faa418dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.176646 Jul 27 09:07:16.375677 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 139/288] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:07:14 2022] POST /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments => generated 194 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:16.636150 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:16.636776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:16.646253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:16.647066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:16.648383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:16.649325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:16.798102 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:16.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:16.805632 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:16.805927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:16.806219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:16.807782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:16.808447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:16.817743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:16.819318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:16.820586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0810025d-df70-414f-9ccd-f3f418dda212 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.189654 Jul 27 09:07:16.824157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 150/289] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:16 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:17.014111 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8915f062c94778b90497966a5f5ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83666bbaa20f41919849a39b38c8a1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:17.022366 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c1b34385-b261-469d-ba89-c07b673cc8ed tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 200 len: 1471 microversion: 2.1 time: 0.229256 Jul 27 09:07:17.023326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 140/290] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:16 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:17.116004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-51cadd16-73d9-46ba-a6ce-796ed4825e85 req-cb30d1f9-8334-4f8c-a153-e33616a3c5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caef81a7-befd-4872-9041-bb4e13064d39", "name": "network-vif-deleted", "tag": "e0f06d57-1deb-457a-a9ab-62542e3e6c14"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:17.127011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-51cadd16-73d9-46ba-a6ce-796ed4825e85 req-cb30d1f9-8334-4f8c-a153-e33616a3c5d8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:17.127618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-51cadd16-73d9-46ba-a6ce-796ed4825e85 req-cb30d1f9-8334-4f8c-a153-e33616a3c5d8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:17.141189 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-51cadd16-73d9-46ba-a6ce-796ed4825e85 req-cb30d1f9-8334-4f8c-a153-e33616a3c5d8 service nova] Creating event network-vif-deleted:e0f06d57-1deb-457a-a9ab-62542e3e6c14 for instance caef81a7-befd-4872-9041-bb4e13064d39 on hv-cinder-79760 Jul 27 09:07:17.147017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-51cadd16-73d9-46ba-a6ce-796ed4825e85 req-cb30d1f9-8334-4f8c-a153-e33616a3c5d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Jul 27 09:07:17.147710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 151/291] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:17.370418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6e41c0ab-c404-4b73-9dc9-e7aaccdabf82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: .version_select at 0x7f6f948ab040>, body: {"keypair": {"name": "tempest-keypair-2004193292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPxD/vo9Lp+mBvEo82QNi7NB8K0AsYilaagOpJE32m1/OA4GlBmcxFIZqoqT1TI+3VuY8v9X4vp4NqHzK/QDIFM+upsvhzsCthF2vSQdHyFzzX/k/qGohZpa6Ya2+Ug9w=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:17.392713 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-6e41c0ab-c404-4b73-9dc9-e7aaccdabf82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for project f91b6498ed874b4cac422867319642bb. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:07:17.396550 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-6e41c0ab-c404-4b73-9dc9-e7aaccdabf82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for user c0b38d0f4f5a4127bc908e07a6629342 and project f91b6498ed874b4cac422867319642bb. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:07:17.433398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6e41c0ab-c404-4b73-9dc9-e7aaccdabf82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067834 Jul 27 09:07:17.434211 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 141/292] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:07:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:17.858012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:17.858724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:17.867498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:17.868175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:17.870185 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:17.871082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:18.038754 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:18.045625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:18.046465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] [instance: caef81a7-befd-4872-9041-bb4e13064d39] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:18.048330 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:18.049927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:18.051191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eea220a3-b932-4381-a277-befdfde32bf6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.208761 Jul 27 09:07:18.051866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 152/293] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:17 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:18.053602 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:18.054228 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:18.054998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:18.055435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:18.070356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] HTTP exception thrown: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Request method failure captured: Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 HTTP/1.1 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QAsGcO-Qxbq6lCUbcKjuu_-_UgncI8MF2hSdYdZKVqT8OzV7ooHKYHcrfeJSDBbjNCAJpdqmxpWLUtVikHw-2bZc75W8CIikUbcFBsMVIPwK-cLCuMhpxIRzCNpqeYhJod1nv94Cd-QR6Z21wTi9PckWQ2FB10MwlXgOR2OODsEMtU Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 83666bbaa20f41919849a39b38c8a1e6 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesNegativeTest-1461330803 Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:07:18.071985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_83666bbaa20f41919849a39b38c8a1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/83666bbaa20f41919849a39b38c8a1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/83666bbaa20f41919849a39b38c8a1e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/83666bbaa20f41919849a39b38c8a1e6"}]}] Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesNegativeTest-1461330803 Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 83666bbaa20f41919849a39b38c8a1e6 Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesNegativeTest-1461330803 Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesNegativeTest-1461330803-project Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 1b8915f062c94778b90497966a5f5ae9 Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesNegativeTest-1461330803-project Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. Jul 27 09:07:18.074139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'caef81a7-befd-4872-9041-bb4e13064d39'} Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:07:18.075070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. Jul 27 09:07:18.076615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:18.077910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] Returning 404 to user: Instance caef81a7-befd-4872-9041-bb4e13064d39 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:07:18.077910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2a692c17-64f8-42af-b549-bccb698ce25d tempest-VolumesNegativeTest-1461330803 tempest-VolumesNegativeTest-1461330803-project] 10.222.0.33 "GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39" status: 404 len: 111 microversion: 2.1 time: 0.032948 Jul 27 09:07:18.080427 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 142/294] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:18 2022] GET /compute/v2.1/servers/caef81a7-befd-4872-9041-bb4e13064d39 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:07:18.921819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1876348958", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ed67304-6657-4210-b748-2a039b60f99b"}], "security_groups": [{"name": "tempest-securitygroup--1413700958"}], "key_name": "tempest-keypair-2004193292", "user_data": "}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:19.049384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] validate_networks() for [('9ed67304-6657-4210-b748-2a039b60f99b', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:07:19.074496 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:19.075107 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:19.082209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:19.082812 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:19.084279 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:19.084911 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:19.244663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:19.254305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:19.255964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:19.257233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6e7f6992-78e5-4e87-878f-a779e098a48a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.186566 Jul 27 09:07:19.258357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 143/295] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:19 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:19.473804 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:07:19.474235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:07:19.475081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:07:19.475185 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:07:19.475538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:07:19.485458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:19.485994 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:19.486915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:19.487391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:19.505659 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:07:19.510539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Getting quotas for user c0b38d0f4f5a4127bc908e07a6629342 and project f91b6498ed874b4cac422867319642bb. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:07:19.523887 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:07:19.526758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:07:19.594234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-67201aac-ad43-4545-9b40-e94b807e0bd5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.678509 Jul 27 09:07:19.595267 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 153/296] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:07:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:07:19.605939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8ef0adc3-5aae-4701-8cbc-34b2591eaf40 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:19.606831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8ef0adc3-5aae-4701-8cbc-34b2591eaf40 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:19.685731 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8ef0adc3-5aae-4701-8cbc-34b2591eaf40 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:19.693567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8ef0adc3-5aae-4701-8cbc-34b2591eaf40 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1246 microversion: 2.1 time: 0.091529 Jul 27 09:07:19.694660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 144/297] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:19 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:20.289171 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:20.289775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:20.296000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:20.296511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:20.297196 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:20.297626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:20.444079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:20.460655 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:20.462345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:20.463786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-82474706-69b6-4768-b8c9-ec2894615da0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.178959 Jul 27 09:07:20.464448 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 154/298] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:20 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:20.719117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:20.720124 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:20.730162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:20.731214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:20.733598 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:20.735420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:20.818811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:20.829784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-190381fb-5e33-4fe3-bf8a-5d122ade79af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1298 microversion: 2.1 time: 0.117651 Jul 27 09:07:20.830371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 145/299] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:20 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:21.492209 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:21.492823 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:21.500401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:21.500859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:21.501639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:21.502078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:21.630451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:21.638713 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:21.640258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:21.641421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d5ed72ef-ba4a-4519-936a-9b68ff2bb7ee tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.154248 Jul 27 09:07:21.641985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 155/300] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:21 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:21.852105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:21.852749 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:21.859987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:21.860436 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:21.861202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:21.861643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:21.926753 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:21.934192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-36e91882-69a3-4678-bdfd-2a320da4ca5d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1304 microversion: 2.1 time: 0.086136 Jul 27 09:07:21.934765 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 146/301] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:21 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:22.664584 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:22.665192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:22.667636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:22.673217 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:22.673697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:22.674441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:22.674880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:22.804422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:22.813773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:22.815503 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:22.816644 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4fd3014b-4760-486a-939c-135be726c2ae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.155924 Jul 27 09:07:22.817258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 156/302] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:22 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:22.954379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:22.955006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:22.961580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:22.962023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:22.963562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:22.964025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:23.026871 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:23.034568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fd1d3597-4cb6-4b5e-ac84-4e182e780b90 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1304 microversion: 2.1 time: 0.083978 Jul 27 09:07:23.035320 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 147/303] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:22 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:23.840505 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:23.841010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:23.847525 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:23.848006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:23.848777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:23.849218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:23.984389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:23.994245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:23.995801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:23.997164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-477490da-6990-471d-bbfb-7c279c931bc8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.161195 Jul 27 09:07:23.997720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 157/304] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:23 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:24.055032 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:24.055648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:24.062532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:24.063190 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:24.064009 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:24.064453 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:24.138829 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:24.146520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8b8fca94-eb04-4e81-ab1b-eb802375d255 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1304 microversion: 2.1 time: 0.095238 Jul 27 09:07:24.147094 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 148/305] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:24 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:25.022465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:25.023073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:25.031625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:25.032536 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:25.033493 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:25.034066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:25.167589 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:25.169097 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:25.171872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:25.189035 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:25.189256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:25.190461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:25.192837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:25.300397 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:25.312869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:25.315496 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:25.317142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4630fbb9-4632-4e93-afc2-e409da667a81 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.300510 Jul 27 09:07:25.318087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 158/306] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:25 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:25.574439 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:25.598831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c855ab85-59ca-45a9-bc7e-95c6130208ab tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.422579 Jul 27 09:07:25.600052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 149/307] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:25 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:26.182393 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-5f2f092f-8621-49af-b18f-7981cda0ea5c req-d9f0e317-2f31-420e-9997-a5dc466f6b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:26.190874 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-93f95795-9c16-4f14-bef7-00f6d670e871 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: .version_select at 0x7f6f948c4670>, body: {"keypair": {"name": "tempest-keypair-2009666668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUQ/DWnDHIBpzFUncHfbw2pxXYlGhOZkDQnYXmzrZHAc1KBmpltXpUrdT1SRf7GHF/ctPi4Dd1X8ZZygYa2yktZSsYVwXgHX2mOBhOZtz5Ap062LeIaLaV5eemnCC2+Fg=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:26.205222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-5f2f092f-8621-49af-b18f-7981cda0ea5c req-d9f0e317-2f31-420e-9997-a5dc466f6b8e service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:26.205672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-5f2f092f-8621-49af-b18f-7981cda0ea5c req-d9f0e317-2f31-420e-9997-a5dc466f6b8e service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:26.219275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-5f2f092f-8621-49af-b18f-7981cda0ea5c req-d9f0e317-2f31-420e-9997-a5dc466f6b8e service nova] Creating event network-changed:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:07:26.221786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-93f95795-9c16-4f14-bef7-00f6d670e871 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:07:26.226804 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-5f2f092f-8621-49af-b18f-7981cda0ea5c req-d9f0e317-2f31-420e-9997-a5dc466f6b8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051602 Jul 27 09:07:26.227420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 159/308] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:26.233258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-93f95795-9c16-4f14-bef7-00f6d670e871 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:07:26.265895 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-93f95795-9c16-4f14-bef7-00f6d670e871 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078945 Jul 27 09:07:26.266972 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 150/309] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:07:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:07:26.345277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:26.346399 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:26.357431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:26.357882 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:26.360015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:26.360692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:26.371857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:26.613916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:26.623268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:26.623939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:26.624098 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:26.625694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:26.627639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e4f11afb-f82c-4bfd-9026-84d31f254bf3 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.287108 Jul 27 09:07:26.628617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 160/310] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:26 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:26.633740 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:26.635399 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:26.636706 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:26.637163 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:26.812008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:26.822304 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-da05d5b5-a97f-4e9f-94c7-90a743ff021e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.203060 Jul 27 09:07:26.823418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 151/311] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:26 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:27.654042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:27.654760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:27.664232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:27.665217 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:27.666640 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:27.667663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:27.845235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:27.846627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:27.854971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:27.855837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:27.856896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:27.857671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:27.882848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:27.893632 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:27.895147 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:27.896363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2163e28f-06a2-4254-a8bd-426dddae61ec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.248527 Jul 27 09:07:27.896929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 161/312] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:27 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:28.039856 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:28.047579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f93cc44b-062c-4d9d-80f6-c172cfbf1e1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.206341 Jul 27 09:07:28.048310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 152/313] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:27 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:28.100775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-293267337", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "effe6ca8-c538-478b-abc9-f3d649387e81"}], "security_groups": [{"name": "tempest-securitygroup--1239000787"}], "key_name": "tempest-keypair-2009666668", "user_data": "}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:28.212154 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] validate_networks() for [('effe6ca8-c538-478b-abc9-f3d649387e81', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:07:28.620889 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:07:28.621389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:07:28.621998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:07:28.622587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:07:28.623117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:07:28.634732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:28.635160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:28.636175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:28.636582 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:28.655591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:07:28.660724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:07:28.673888 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:07:28.675936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:07:28.731068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8f024062-d2ae-4343-981f-d55de3747bd4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.635289 Jul 27 09:07:28.731957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 162/314] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:07:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 09:07:28.743253 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-26e7fb13-be3d-4e79-b482-5a962d5306b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:28.743988 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-26e7fb13-be3d-4e79-b482-5a962d5306b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:28.873410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-26e7fb13-be3d-4e79-b482-5a962d5306b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:28.892259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-26e7fb13-be3d-4e79-b482-5a962d5306b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1241 microversion: 2.1 time: 0.153025 Jul 27 09:07:28.910736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 153/315] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:28 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:28.920779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:28.921645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:28.928839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:28.929288 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:28.930061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:28.930678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:29.069619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:29.070228 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:29.079797 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:29.080488 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:29.082117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:29.082729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:29.164766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:29.176068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:29.179375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:29.182252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1f2461bf-f071-4403-a64e-1c50057119a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.265215 Jul 27 09:07:29.183379 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 163/316] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:28 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:29.306816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:29.314587 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2b8dd72e-bcfd-411d-8341-f302b80144af tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.249963 Jul 27 09:07:29.315726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 154/317] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:29 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:29.917424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:29.918036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:29.924663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:29.925111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:29.925877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:29.926314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:29.987574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:29.995631 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9f4c7726-7a04-4fff-a97c-688efb1a3afb tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1301 microversion: 2.1 time: 0.082051 Jul 27 09:07:29.996339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 164/318] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:29 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:30.207012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:30.207667 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:30.214074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:30.214513 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:30.215265 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:30.215694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:30.338045 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:30.338766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:30.345205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:30.345649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:30.345767 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:30.346644 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:30.347152 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:30.353720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:30.355225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:30.356432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8e6b8633-079e-4964-a65a-7cbfa8a0999e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.153338 Jul 27 09:07:30.356991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 155/319] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:30 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:30.484829 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:30.495474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cb693cce-5cfa-458e-92d6-8a6d9aeacd68 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.161789 Jul 27 09:07:30.496096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 165/320] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:30 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:31.016747 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:31.017280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:31.023776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.024230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.025049 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.025475 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.096175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:31.103901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8cdcfc8b-965d-4686-8c5e-7903bfde3c40 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1299 microversion: 2.1 time: 0.090952 Jul 27 09:07:31.104664 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 156/321] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:31 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:31.378511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:31.379124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:31.386465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.386910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.387719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.388189 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.519240 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:31.521262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:31.529321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.530022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.530989 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:31.531592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:31.535077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:31.545807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:31.547409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:31.549836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9d9a1572-8131-4b2b-a381-5b5406e77d5c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.175297 Jul 27 09:07:31.556491 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 166/322] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:31 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:31.737054 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:31.744583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f02411ed-3100-4f7b-9594-4e85108dde50 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.230171 Jul 27 09:07:31.745157 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 157/323] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:31 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:32.124936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:32.125868 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:32.133222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.134246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.135510 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.136213 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.295279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:32.303663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d3055865-1b29-4517-b92e-bc2d59d09226 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.182901 Jul 27 09:07:32.304721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 167/324] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:32 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:32.317465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-28af377f-00cf-4474-a92b-6a93f92558aa req-c18a54df-d517-4231-a9e9-b74e61e3c15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35cc48c5-70ac-463e-98a8-0e4241df0ea6", "tag": "65536b71-1cb0-4ef5-b038-29a311492d3b"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:32.339156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-28af377f-00cf-4474-a92b-6a93f92558aa req-c18a54df-d517-4231-a9e9-b74e61e3c15a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.339608 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-28af377f-00cf-4474-a92b-6a93f92558aa req-c18a54df-d517-4231-a9e9-b74e61e3c15a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.356266 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-28af377f-00cf-4474-a92b-6a93f92558aa req-c18a54df-d517-4231-a9e9-b74e61e3c15a service nova] Creating event network-changed:65536b71-1cb0-4ef5-b038-29a311492d3b for instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 on hv-cinder-79760 Jul 27 09:07:32.361378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-28af377f-00cf-4474-a92b-6a93f92558aa req-c18a54df-d517-4231-a9e9-b74e61e3c15a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055396 Jul 27 09:07:32.362071 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 158/325] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:07:32.574598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:32.575215 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:32.582442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.582876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.583671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.584164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.728412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:32.736459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:32.737956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:32.739207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6459beae-dbf1-4cb0-a59a-fb9c353216ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.168557 Jul 27 09:07:32.739793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 168/326] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:32 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:32.767342 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:32.768164 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:32.774956 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.775415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.776216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.776772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.896354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:32.896944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:32.904393 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.905124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.905931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:32.906374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:32.955721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:32.963739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-16b5c5d8-97bd-4fd3-a333-3def18ad5ae8 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.201083 Jul 27 09:07:32.964330 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 159/327] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:32 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:33.057926 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lazy-loading 'services' on Instance uuid 92ed869d-cc3e-4470-baf9-02e2249886d7 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:07:33.181761 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-38a8c9b1-dc84-4380-aece-a7010a903bde tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7/os-volume_attachments/9efb3690-384c-4485-b2f6-a2a774d6cbcd" status: 202 len: 0 microversion: 2.1 time: 0.288478 Jul 27 09:07:33.182546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 169/328] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:07:32 2022] DELETE /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7/os-volume_attachments/9efb3690-384c-4485-b2f6-a2a774d6cbcd => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:07:33.325084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:33.325701 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:33.331823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.332276 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:33.333038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.333474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:33.466720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:33.474211 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d4937c50-af4c-4b48-9362-ea55ddf8655f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.153535 Jul 27 09:07:33.474773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 160/329] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:33 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:33.765292 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:33.765997 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:33.772309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.772798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:33.773610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.774084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:33.907985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:33.917141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:33.918678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:33.919870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7ca36bbb-0537-4b51-9206-9c5499a2c0bc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.159315 Jul 27 09:07:33.920440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 170/330] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:33 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:33.984450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:33.985067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:33.994000 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.994449 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:33.995225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:33.995655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:34.014772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:34.155023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:34.162547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7ea5330a-a86e-4720-aa3e-478af34d584c tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.181898 Jul 27 09:07:34.163122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 161/331] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:33 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:34.498340 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:34.499255 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:34.505767 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:34.506239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:34.507007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:34.507458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:34.654274 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:34.662264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a8eecb93-3f92-48de-83c2-03ee0638d5c1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.168728 Jul 27 09:07:34.662940 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 171/332] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:34 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:34.945092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:34.946009 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:34.953861 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:34.954432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:34.955317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:34.955886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.088313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.097410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.099111 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.100326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ecfff117-f76a-45a3-bd15-cbdf8cb0e717 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.159657 Jul 27 09:07:35.100891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 162/333] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:34 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:35.183273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:35.183919 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:35.190484 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.190933 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.191710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.192175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.321052 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.329252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cfaa9853-e106-4b8e-b6cb-e19d50e3d303 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.150418 Jul 27 09:07:35.330017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 172/334] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:35 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:35.360998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:35.361496 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:35.367557 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.368032 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.368834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.369265 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.394233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:07:35.467312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4a36fe4d-7eb2-47e0-aca9-5c08dd2d587e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 204 len: 0 microversion: 2.1 time: 0.109964 Jul 27 09:07:35.467926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 163/335] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:07:35 2022] DELETE /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:07:35.492796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:35.493689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:35.501306 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.501759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.502543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.502979 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.636387 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.643955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-56da93c8-5ea3-4a2f-a8f4-2dcac9439993 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1514 microversion: 2.1 time: 0.163764 Jul 27 09:07:35.644540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 173/336] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:35 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:35.689365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:35.690536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:35.697777 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.698218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.698988 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:35.699422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:35.827810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:35.835178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-463fa4ae-7333-454a-98d3-5385268b1cc9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.153389 Jul 27 09:07:35.835690 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 164/337] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:35 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:36.122802 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:36.123336 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:36.129549 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.130001 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.130770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.131205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.261298 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:36.269077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:36.270569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:36.271704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3a563105-3e1a-4898-a45b-772ad0c4e3e1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.153466 Jul 27 09:07:36.272279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 174/338] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:36 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:36.351323 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:36.352384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:36.359091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.359542 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.360365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.360831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.495463 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:36.503352 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9ccce37c-684d-4d85-8c46-569d2ad60906 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.156805 Jul 27 09:07:36.504123 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 165/339] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:36 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:36.653312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-21737cad-cdca-46db-ab69-4642b533fdd9 req-618c75e0-cf51-4e62-8c64-973ae679ef43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "name": "network-vif-plugged", "status": "completed", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:36.662696 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-21737cad-cdca-46db-ab69-4642b533fdd9 req-618c75e0-cf51-4e62-8c64-973ae679ef43 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.663184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-21737cad-cdca-46db-ab69-4642b533fdd9 req-618c75e0-cf51-4e62-8c64-973ae679ef43 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.669305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:36.669977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:36.682083 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-21737cad-cdca-46db-ab69-4642b533fdd9 req-618c75e0-cf51-4e62-8c64-973ae679ef43 service nova] Creating event network-vif-plugged:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:07:36.687445 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.687724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.687884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-21737cad-cdca-46db-ab69-4642b533fdd9 req-618c75e0-cf51-4e62-8c64-973ae679ef43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038075 Jul 27 09:07:36.688912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.689498 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.689757 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 175/340] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:36.831115 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:36.840036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c090bba3-1663-4dbf-86ac-471169399a06 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1514 microversion: 2.1 time: 0.174901 Jul 27 09:07:36.841042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 166/341] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:36 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:36.860003 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:36.860698 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:36.873672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.874165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:36.874972 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:36.875406 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.014790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.022193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f057648a-9dfc-4779-aa8c-bddeb3750b55 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.169577 Jul 27 09:07:37.022773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 176/342] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:36 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:37.296512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:37.297042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:37.303389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.303875 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.304665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.305126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.494960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.503423 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.505033 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.506283 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-db8628af-62f0-4e59-bfb2-0c12500bfc36 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.213826 Jul 27 09:07:37.507149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 167/343] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:37 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:37.525361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:37.525997 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:37.532608 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.533090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.533876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.534318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.551130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:37.741166 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.748704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-919010fa-6e4b-4d3e-bb72-be7486ee60a9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.227738 Jul 27 09:07:37.749284 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 177/344] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:37 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:37.864041 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:37.864584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:37.871442 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.871964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.872726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.873188 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:37.944568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:37.952153 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1a098601-8d2a-4f64-883b-e246c4b926cd tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1472 microversion: 2.1 time: 0.092219 Jul 27 09:07:37.952727 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 168/345] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:37 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:37.987033 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-dc97cce6-6d54-4da3-99f8-688eb62a2d48 req-10d901fb-dfff-41b9-bdba-9221f601b161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ed869d-cc3e-4470-baf9-02e2249886d7", "name": "network-vif-deleted", "tag": "f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:37.997214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-dc97cce6-6d54-4da3-99f8-688eb62a2d48 req-10d901fb-dfff-41b9-bdba-9221f601b161 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:37.997646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-dc97cce6-6d54-4da3-99f8-688eb62a2d48 req-10d901fb-dfff-41b9-bdba-9221f601b161 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.008314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-dc97cce6-6d54-4da3-99f8-688eb62a2d48 req-10d901fb-dfff-41b9-bdba-9221f601b161 service nova] Creating event network-vif-deleted:f1723ccf-2afb-40cd-84dc-4e0d32ef6fdc for instance 92ed869d-cc3e-4470-baf9-02e2249886d7 on hv-cinder-79760 Jul 27 09:07:38.013379 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-dc97cce6-6d54-4da3-99f8-688eb62a2d48 req-10d901fb-dfff-41b9-bdba-9221f601b161 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030066 Jul 27 09:07:38.013956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 178/346] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:38.043708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:38.044337 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:38.050414 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.050863 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.051624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.052082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.179687 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:38.188025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c0b29910-ce51-40c3-815b-2ee4334efe8a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.148975 Jul 27 09:07:38.188629 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 169/347] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:38 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:38.530465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:38.531160 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:38.537793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.538244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.539015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.539447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.645574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:38.668145 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=12 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:38.682646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:38.689635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:38.691151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:38.692395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b2564850-8b69-4dc6-acd7-f71da62e0a60 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1745 microversion: 2.20 time: 0.166173 Jul 27 09:07:38.693488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 179/348] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:38 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:38.720555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-b68a02e9-7911-44bb-9d08-304e84a6b8ac req-a24ed2ee-8351-40bc-afdf-85a3c0ddb5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cc48c5-70ac-463e-98a8-0e4241df0ea6", "name": "network-vif-plugged", "status": "completed", "tag": "65536b71-1cb0-4ef5-b038-29a311492d3b"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:38.731073 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-b68a02e9-7911-44bb-9d08-304e84a6b8ac req-a24ed2ee-8351-40bc-afdf-85a3c0ddb5d2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.731518 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-b68a02e9-7911-44bb-9d08-304e84a6b8ac req-a24ed2ee-8351-40bc-afdf-85a3c0ddb5d2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.742648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-b68a02e9-7911-44bb-9d08-304e84a6b8ac req-a24ed2ee-8351-40bc-afdf-85a3c0ddb5d2 service nova] Creating event network-vif-plugged:65536b71-1cb0-4ef5-b038-29a311492d3b for instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 on hv-cinder-79760 Jul 27 09:07:38.748096 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-b68a02e9-7911-44bb-9d08-304e84a6b8ac req-a24ed2ee-8351-40bc-afdf-85a3c0ddb5d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031205 Jul 27 09:07:38.748674 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 170/349] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:38.770448 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:38.771095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:38.777962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.778390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.779583 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.779721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.926742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:38.934186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5be948db-36e5-4de5-bbab-7969f0ad1ba5 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1372 microversion: 2.1 time: 0.167627 Jul 27 09:07:38.934760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 180/350] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:38 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:38.970720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=12 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:38.974839 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:38.975544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:38.982727 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.983171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:38.983992 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:38.984429 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.016029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.016471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.016917 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lazy-loading 'fault' on Instance uuid 92ed869d-cc3e-4470-baf9-02e2249886d7 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:07:39.060200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:39.067665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2287f4b2-fd43-4df2-87c7-fcb214082e10 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 200 len: 1309 microversion: 2.1 time: 0.097891 Jul 27 09:07:39.068248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 171/351] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:38 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:39.210244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:39.210902 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:39.217641 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.218094 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.218896 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.219338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.359286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:39.369120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a0dd0113-46fe-46fc-a8a3-78f42a47dda5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.162019 Jul 27 09:07:39.370634 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 181/352] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:39 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:39.715994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:39.716638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:39.722749 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.723281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.724068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.724509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.851422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:39.860111 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:39.861628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:39.862800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1b644245-2011-4c05-98b6-c8f164fa6941 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1745 microversion: 2.20 time: 0.151255 Jul 27 09:07:39.863357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 172/353] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:39 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:39.954622 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:39.955159 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:39.961629 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.962651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:39.963456 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:39.963923 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.089174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:40.089904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 92ed869d-cc3e-4470-baf9-02e2249886d7] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:40.096373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.097022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.098179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.098669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.099307 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:40.106999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c269c749-3d69-447c-8d40-b53875ebd964 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1566 microversion: 2.1 time: 0.156346 Jul 27 09:07:40.107576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 182/354] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:39 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:40.112511 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] HTTP exception thrown: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Request method failure captured: Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 HTTP/1.1 Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P_9QKkLc4PqxuiytXGhAg6iH74W2vjWIdtsDiWrSGZZnrUY0vk7SYBxHcQQcvX4rTGQPuIKYvdVX5EqYpWkKBvwksFfav2hfHeyw3moQGX9VE-Jpwg5HW-BuqnYM3oWbplgzMdGXD9utVS7bEuGxCzfbbW0BEsmUI413gyRBBN86pA Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 5b4aed934a6a4fd6a8311bb3fd048d4f Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:07:40.114172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}] Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 5b4aed934a6a4fd6a8311bb3fd048d4f Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesSnapshotTestJSON-524896930-project Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 4c3e576003a74e0b9dc7463497d61cd9 Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesSnapshotTestJSON-524896930-project Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. Jul 27 09:07:40.115468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '92ed869d-cc3e-4470-baf9-02e2249886d7'} Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:07:40.116312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. Jul 27 09:07:40.117537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:07:40.118738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Returning 404 to user: Instance 92ed869d-cc3e-4470-baf9-02e2249886d7 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:07:40.118738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-016901a8-6a06-4881-a4c0-00612f8639ce tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7" status: 404 len: 111 microversion: 2.1 time: 0.031154 Jul 27 09:07:40.118738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 173/355] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:40 2022] GET /compute/v2.1/servers/92ed869d-cc3e-4470-baf9-02e2249886d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:07:40.129046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:40.129546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:40.137925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.138386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.139171 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.139611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.221400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d9c1e079-d274-4871-af84-d3aa3fa2adba tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096152 Jul 27 09:07:40.222010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 183/356] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:07:40 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:40.391189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:40.393144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:40.401237 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.401679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.402448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.403103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.886342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:40.886950 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:40.893152 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.893598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.894371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:40.895439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:40.926593 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:40.935732 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7ad554f4-7b52-43e7-a864-68106fa8e51c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.548690 Jul 27 09:07:40.936958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 174/357] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:40 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:41.025434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:41.033656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:41.035172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:41.036370 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-54a42a8c-bd1e-4113-9be8-8585879d6f6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.154258 Jul 27 09:07:41.037151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 184/358] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:40 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:41.511371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-e1b3a0a9-87c4-4898-ae15-a2ac950d7cc9 req-28f93fa4-8d10-4de1-9d7a-9eca2384caab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:41.520810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-e1b3a0a9-87c4-4898-ae15-a2ac950d7cc9 req-28f93fa4-8d10-4de1-9d7a-9eca2384caab service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:41.521246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-e1b3a0a9-87c4-4898-ae15-a2ac950d7cc9 req-28f93fa4-8d10-4de1-9d7a-9eca2384caab service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:41.534045 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-e1b3a0a9-87c4-4898-ae15-a2ac950d7cc9 req-28f93fa4-8d10-4de1-9d7a-9eca2384caab service nova] Creating event network-changed:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:07:41.538884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-e1b3a0a9-87c4-4898-ae15-a2ac950d7cc9 req-28f93fa4-8d10-4de1-9d7a-9eca2384caab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031912 Jul 27 09:07:41.539480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 175/359] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:41.958535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:41.959156 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:41.966183 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:41.966660 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:41.967439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:41.967937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:42.061344 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:42.062201 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:42.068637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:42.069303 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:42.070187 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:42.071042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:42.104890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:42.123794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-034d408f-1c8a-4051-8f13-7386091e59d7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.169101 Jul 27 09:07:42.124695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 185/360] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:41 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:42.216440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:42.224958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:42.226579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:42.228843 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c4722b46-2520-4066-a442-424daee6fc43 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.172407 Jul 27 09:07:42.229548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 176/361] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:42 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:43.150936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:43.152371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:43.162798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:43.163000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:43.164451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:43.165084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:43.252216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:43.253462 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:43.261041 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:43.272502 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:43.274426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:43.277557 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:43.337651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:43.347036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-67430b2a-a53b-40c2-bc63-fc6f8a79c8dc tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1367 microversion: 2.1 time: 0.205119 Jul 27 09:07:43.360494 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 186/362] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:43 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:43.472151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:43.480619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:43.482775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:43.484164 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-12a0320f-cb97-4616-8e69-2db8b3870d6a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.235835 Jul 27 09:07:43.496606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 177/363] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:43 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:44.369075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:44.369664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:44.380438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.381269 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.382209 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.382969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.508215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:44.511008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:44.518411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.519247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.520378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.520995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.526271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:44.580798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:44.593729 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d5783790-86ef-43a0-8826-0b9fa89a8568 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1557 microversion: 2.1 time: 0.228711 Jul 27 09:07:44.595061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 187/364] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:44 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:07:44.615238 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:44.615977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:44.623059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.623626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.624510 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:44.625016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:44.758689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:44.759935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5df4fdc1-b9a3-4db6-be9e-36b9d3e206d9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148233 Jul 27 09:07:44.768087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 188/365] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:07:44 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:44.775659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:44.777403 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:44.778822 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cd9589ce-67ee-4d90-811e-cb71efb1c2a5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.274449 Jul 27 09:07:44.792301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 178/366] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:44 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:45.345579 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-ed5a096e-9604-4981-9ce2-61d97364a63c req-7a3c757d-ba09-46eb-9811-33f288b12049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "name": "network-vif-plugged", "status": "completed", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:45.365820 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ed5a096e-9604-4981-9ce2-61d97364a63c req-7a3c757d-ba09-46eb-9811-33f288b12049 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:45.366718 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ed5a096e-9604-4981-9ce2-61d97364a63c req-7a3c757d-ba09-46eb-9811-33f288b12049 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:45.385517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-ed5a096e-9604-4981-9ce2-61d97364a63c req-7a3c757d-ba09-46eb-9811-33f288b12049 service nova] Creating event network-vif-plugged:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:07:45.445122 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-ed5a096e-9604-4981-9ce2-61d97364a63c req-7a3c757d-ba09-46eb-9811-33f288b12049 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100225 Jul 27 09:07:45.447077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 189/367] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:07:45.802554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:45.803212 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:45.815477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:45.815952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:45.817564 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:45.818156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:46.044754 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:46.059850 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:46.061722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:46.063076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-37df1a62-62b5-4e22-8bb7-22a8bbf8851b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.264437 Jul 27 09:07:46.064120 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 179/368] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:45 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:46.395932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-a74a3ef0-a7b4-4252-807d-413beeea84e2 req-83c440f3-61fd-44e5-b7a7-35da09bbcae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35cc48c5-70ac-463e-98a8-0e4241df0ea6", "tag": "65536b71-1cb0-4ef5-b038-29a311492d3b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:46.420088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a74a3ef0-a7b4-4252-807d-413beeea84e2 req-83c440f3-61fd-44e5-b7a7-35da09bbcae5 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:46.420536 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a74a3ef0-a7b4-4252-807d-413beeea84e2 req-83c440f3-61fd-44e5-b7a7-35da09bbcae5 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:46.448897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-a74a3ef0-a7b4-4252-807d-413beeea84e2 req-83c440f3-61fd-44e5-b7a7-35da09bbcae5 service nova] Creating event network-changed:65536b71-1cb0-4ef5-b038-29a311492d3b for instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 on hv-cinder-79760 Jul 27 09:07:46.455903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-a74a3ef0-a7b4-4252-807d-413beeea84e2 req-83c440f3-61fd-44e5-b7a7-35da09bbcae5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063992 Jul 27 09:07:46.456772 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 190/369] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:47.089897 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:47.090507 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:47.097979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:47.098738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:47.099769 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:47.100456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:47.273118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:47.282663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:47.284243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:47.285636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-638c0d4b-01c8-4230-9131-3b8c9ec76edb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.199694 Jul 27 09:07:47.286379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 180/370] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:47 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:48.218193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2144135476", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "networks": [{"uuid": "89f41923-b8a1-4774-8d85-70c6e6a48732"}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:48.277771 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] validate_networks() for [('89f41923-b8a1-4774-8d85-70c6e6a48732', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:07:48.310879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:48.312286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:48.319458 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:48.320055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:48.321030 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:48.321577 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:48.495573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:48.512603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:48.514353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:48.515695 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3b6a4626-50a9-47bd-bd2f-a84509f603c6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.208649 Jul 27 09:07:48.516746 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 181/371] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:48 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:07:48.851258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:07:48.852529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:07:48.853364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:07:48.854007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:07:48.854633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:07:48.870039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:48.871332 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:48.872431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:48.873119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:48.896974 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Getting quotas for project 5b4aed934a6a4fd6a8311bb3fd048d4f. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:07:48.907311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Getting quotas for user 4c3e576003a74e0b9dc7463497d61cd9 and project 5b4aed934a6a4fd6a8311bb3fd048d4f. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:07:48.921297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:07:48.923948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:07:48.947604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:48.986344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-31c230cf-ff00-4617-a44d-f7586187f8e6 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772221 Jul 27 09:07:48.993477 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 191/372] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:07:48.998323 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-dc8e59aa-cf16-4e2f-bdb4-e6722fb88116 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:48.999179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-dc8e59aa-cf16-4e2f-bdb4-e6722fb88116 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:49.122143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dc8e59aa-cf16-4e2f-bdb4-e6722fb88116 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:49.137823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-dc8e59aa-cf16-4e2f-bdb4-e6722fb88116 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1219 microversion: 2.1 time: 0.143059 Jul 27 09:07:49.152068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 182/373] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:48 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:49.541977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:49.542783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:49.574171 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:49.574962 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:49.577091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:49.577790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:49.774340 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:49.788684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:49.790264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:49.791431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0b94ac78-3172-4b0c-8afb-5052473d58b5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.256541 Jul 27 09:07:49.792025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 192/374] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:49 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:50.174472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:50.175080 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:50.186706 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:50.187153 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:50.191959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:50.192810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:50.262253 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:50.269952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-29333f51-597b-475d-9113-438d08dcd36c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1271 microversion: 2.1 time: 0.101078 Jul 27 09:07:50.270515 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 183/375] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:50 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:50.818914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:50.820161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:50.827697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:50.828263 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:50.829233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:50.829848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:51.091345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:51.110741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:51.113626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:51.115200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d331c467-66fc-45cb-a932-61664ba4ad6e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.300570 Jul 27 09:07:51.115835 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 193/376] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:50 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:51.317264 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:51.318106 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:51.326270 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:51.326567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:51.327536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:51.328128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:51.399920 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:51.419133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-26a85497-c444-4b63-a771-f6ed1ab08d0e tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1277 microversion: 2.1 time: 0.104907 Jul 27 09:07:51.433814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 184/377] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:51 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:52.139245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:52.140593 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:52.147483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:52.147968 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:52.148970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:52.149565 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:52.380467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:52.390825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:52.392691 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:52.394010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b3635908-6c3a-4621-a024-db95149b149a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1740 microversion: 2.20 time: 0.258558 Jul 27 09:07:52.394611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 194/378] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:52 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:52.446502 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:52.447127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:52.453889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:52.454535 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:52.455310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:52.455783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:52.596521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:52.604081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f94c603b-37fc-4ea0-a506-8635a033c248 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.161441 Jul 27 09:07:52.604666 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 185/379] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:52 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:52.831743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-dd74a2bf-da7d-464d-9740-5b97946dcf0d req-ad4c3497-d484-4a71-b681-362bd660a6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ff6527-5aab-4bb4-a4f1-ba7edbe849ac", "tag": "49e97a36-d01a-4d6a-b503-c27a97d036e1"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:52.843726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-dd74a2bf-da7d-464d-9740-5b97946dcf0d req-ad4c3497-d484-4a71-b681-362bd660a6f8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:52.844304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-dd74a2bf-da7d-464d-9740-5b97946dcf0d req-ad4c3497-d484-4a71-b681-362bd660a6f8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:52.857267 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-dd74a2bf-da7d-464d-9740-5b97946dcf0d req-ad4c3497-d484-4a71-b681-362bd660a6f8 service nova] Creating event network-changed:49e97a36-d01a-4d6a-b503-c27a97d036e1 for instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac on hv-cinder-79760 Jul 27 09:07:52.869522 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-dd74a2bf-da7d-464d-9740-5b97946dcf0d req-ad4c3497-d484-4a71-b681-362bd660a6f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044066 Jul 27 09:07:52.870281 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 195/380] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:53.419470 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:53.420619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:53.427412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:53.427906 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:53.428685 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:53.429123 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:53.559068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:53.566974 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:53.568521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:53.569680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-488be957-fd6e-43d1-adf1-85302289d624 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1722 microversion: 2.20 time: 0.155978 Jul 27 09:07:53.570241 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 186/381] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:53 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:53.627224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:53.627944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:53.634942 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:53.635387 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:53.636184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:53.636620 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:53.768858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:53.777008 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e374b73b-67d0-481b-ac73-1d24babd67b5 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.154408 Jul 27 09:07:53.777575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 196/382] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:53 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:54.593288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:54.594165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:54.600997 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:54.601443 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:54.602715 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:54.603151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:54.746926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:54.755154 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:54.756719 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:54.758400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d2b5b23c-5245-4a95-841c-72c927d5bed6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1722 microversion: 2.20 time: 0.168573 Jul 27 09:07:54.758955 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 187/383] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:54 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:54.798119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:54.798722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:54.806015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:54.806541 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:54.807374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:54.807832 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:54.945455 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:54.953316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7a07a930-6d96-4b0a-8799-9deb250d8cbb tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.159012 Jul 27 09:07:54.953876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 197/384] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:54 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:55.782183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:55.783137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:55.786479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:55.792579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:55.793127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:55.794043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:55.794572 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:55.979771 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:55.981848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:55.993512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:55.994307 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:55.995658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:55.996701 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:56.005188 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:56.036627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:56.045612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:56.047105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:56.053186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3f8a1656-3177-4042-b143-40e6419142d4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1722 microversion: 2.20 time: 0.274913 Jul 27 09:07:56.055048 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 188/385] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:55 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:56.153597 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:56.161015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e07d0564-a8cd-4136-a255-0677b0f3e55c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.190113 Jul 27 09:07:56.161776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 198/386] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:55 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:57.077461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:57.078075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:57.084667 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.085168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.085978 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.086961 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.182579 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:57.183323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:57.189851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.190303 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.191870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.192343 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.219500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:57.228883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:57.230494 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:57.231794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2746a6bc-d155-4ef2-a2de-a0251cfd3bae tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1665 microversion: 2.20 time: 0.158172 Jul 27 09:07:57.236412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 189/387] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:57 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:57.254692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155b7530-6e09-4817-953d-df4f30e05e7f"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:57.257108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:57.263536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.264023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.264813 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.265253 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.331475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:57.339730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-15a12478-6698-43fe-a90e-65078d2809ef tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.161002 Jul 27 09:07:57.340182 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 199/388] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:57 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:57.344719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-d43802d3-c58f-4b2e-8781-866adab4ca1c req-5f143343-f066-4b27-8dd6-a04ec36ed429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ff6527-5aab-4bb4-a4f1-ba7edbe849ac", "name": "network-vif-plugged", "status": "completed", "tag": "49e97a36-d01a-4d6a-b503-c27a97d036e1"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:57.354352 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-d43802d3-c58f-4b2e-8781-866adab4ca1c req-5f143343-f066-4b27-8dd6-a04ec36ed429 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.354791 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-d43802d3-c58f-4b2e-8781-866adab4ca1c req-5f143343-f066-4b27-8dd6-a04ec36ed429 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.366438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-d43802d3-c58f-4b2e-8781-866adab4ca1c req-5f143343-f066-4b27-8dd6-a04ec36ed429 service nova] Creating event network-vif-plugged:49e97a36-d01a-4d6a-b503-c27a97d036e1 for instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac on hv-cinder-79760 Jul 27 09:07:57.371928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-d43802d3-c58f-4b2e-8781-866adab4ca1c req-5f143343-f066-4b27-8dd6-a04ec36ed429 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030388 Jul 27 09:07:57.372545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 200/389] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:07:57.604295 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-43b72fa9-4ef0-416d-8584-7d3446aa0211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353519 Jul 27 09:07:57.605023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 190/390] 10.222.0.33 () {62 vars in 1364 bytes} [Wed Jul 27 09:07:57 2022] POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 09:07:57.732533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:57.733211 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:57.739434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.739922 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.740690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.741234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.833072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d5616be1-55cb-47e7-bda2-e51cb0c22095 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/action" status: 202 len: 0 microversion: 2.20 time: 0.104804 Jul 27 09:07:57.833684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 201/391] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Jul 27 09:07:57 2022] POST /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:07:57.842372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:57.843018 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:57.849957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.850547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.851227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:57.851668 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:57.989628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:57.999007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:58.000646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:58.001841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e1f22060-e55a-40ec-bef5-8ffd16df1048 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1751 microversion: 2.20 time: 0.163352 Jul 27 09:07:58.002395 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 191/392] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:57 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:58.362883 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:58.363499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:58.371057 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:58.371521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:58.372390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:58.372915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:58.506014 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:58.514058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-30cf38b9-d864-4cc4-9f26-823a74b67021 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1319 microversion: 2.1 time: 0.155258 Jul 27 09:07:58.514661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 202/393] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:58 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:59.026227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:59.026837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:59.033451 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.033898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.035013 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.035461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.135620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:59.165550 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:59.173717 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:59.175215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:59.176547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-68bf7426-08c7-4245-9d09-551a34e2b839 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1751 microversion: 2.20 time: 0.154880 Jul 27 09:07:59.177135 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 192/394] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:07:59 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:07:59.396204 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-0d62170c-335f-4c6a-afc4-46765106b1a3 req-07500a3e-7be1-4860-beb3-d448259ba0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "name": "network-vif-unplugged", "status": "completed", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:59.401708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:59.402367 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:59.408604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0d62170c-335f-4c6a-afc4-46765106b1a3 req-07500a3e-7be1-4860-beb3-d448259ba0b6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.409038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0d62170c-335f-4c6a-afc4-46765106b1a3 req-07500a3e-7be1-4860-beb3-d448259ba0b6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.421652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.compute.server_external_events [req-0d62170c-335f-4c6a-afc4-46765106b1a3 req-07500a3e-7be1-4860-beb3-d448259ba0b6 service nova] Unable to find a host for instance 20213da7-326f-41bd-b775-0fb7238203e9. Dropping event network-vif-unplugged {{(pid=117923) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 09:07:59.422645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-0d62170c-335f-4c6a-afc4-46765106b1a3 req-07500a3e-7be1-4860-beb3-d448259ba0b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030223 Jul 27 09:07:59.423214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 203/395] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 09:07:59.536045 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:07:59.536659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:59.543383 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.543933 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.544752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.545208 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.549078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:59.683533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:07:59.691141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-50835900-5e63-41dc-9ea1-b23cb57cb514 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1509 microversion: 2.1 time: 0.158939 Jul 27 09:07:59.691698 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 193/396] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:07:59 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:07:59.714877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b636a9b-d765-4f30-bf87-052bafec5b6e", "device": "/dev/sdb"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:07:59.717320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:07:59.723893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.724423 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.725585 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:07:59.726192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:07:59.985995 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cac2ef8e-d5f6-4a0f-a189-d687af9618b2 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "POST /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275287 Jul 27 09:07:59.986887 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 204/397] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:07:59 2022] POST /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:00.200332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:00.200942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:00.207584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:00.208084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:00.208851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:00.209310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:00.345161 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:00.354124 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:00.355603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:00.356774 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7f89d7f9-f748-42ef-92ac-13843299ff87 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.160362 Jul 27 09:08:00.357324 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 194/398] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:00 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:01.386691 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:01.388911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:01.397074 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:01.397878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:01.400146 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:01.400851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:01.593956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:01.610368 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:01.612291 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:01.613576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5f86d1be-be9e-446a-91f3-e2418221c868 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.237313 Jul 27 09:08:01.614371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 205/399] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:01 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:02.640940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:02.641698 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:02.649923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:02.650463 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:02.651319 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:02.651864 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:02.796658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:02.805715 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:02.807247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:02.808476 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-62ef14ee-9268-4737-af0c-d3d96ab2d5e6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.172374 Jul 27 09:08:02.809217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 195/400] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:02 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:03.837929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:03.838542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:03.845561 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:03.846016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:03.846809 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:03.847352 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:03.988520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:04.004285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:04.007139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:04.013048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-60b9569d-fae3-4181-8286-afd6adf0b745 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.179009 Jul 27 09:08:04.014295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 206/401] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:03 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:05.057333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:05.058040 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:05.065402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:05.066072 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:05.066923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:05.067621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:05.212763 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:05.222510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:05.224089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:05.225227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4e11a2ea-87a8-4cee-aecc-d8f99e75d935 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.176114 Jul 27 09:08:05.225780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 196/402] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:05 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:06.252695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:06.253895 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:06.263672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:06.264253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:06.265861 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:06.265861 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:06.421765 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:06.432578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:06.434261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:06.435541 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eb56b594-d30b-4cce-bf11-820878140e2e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.190471 Jul 27 09:08:06.436328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 207/403] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:06 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:07.464173 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:07.464783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:07.472427 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:07.472971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:07.473859 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:07.474526 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:07.628576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:07.637660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:07.639219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:07.640761 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-798a5ad0-e767-4573-9308-bf9a5e2bb2e5 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.183496 Jul 27 09:08:07.641409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 197/404] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:07 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:08.666943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:08.667885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:08.675843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:08.675843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:08.676687 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:08.677125 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:08.842872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:08.851978 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:08.853764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:08.854923 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-da7df70a-3bec-4917-a9c1-11ff583fc71d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.192235 Jul 27 09:08:08.855642 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 208/405] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:08 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:09.879848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:09.880479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:09.888383 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:09.888832 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:09.889622 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:09.890060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:10.030838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:10.040464 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:10.041970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:10.043133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-32df6ea7-1594-4372-ad28-fe65610a5f7b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.167918 Jul 27 09:08:10.043694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 198/406] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:09 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:11.073884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:11.074526 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:11.081394 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:11.081847 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:11.082628 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:11.083068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:11.237574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:11.248428 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:11.249925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:11.251089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f83c95fc-f35f-4419-83cf-cb5f9fa1e619 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.181835 Jul 27 09:08:11.251655 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 209/407] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:11 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:12.277506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:12.278311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:12.284569 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:12.285016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:12.285784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:12.286210 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:12.426602 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:12.435261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:12.436776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:12.437937 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-db854572-9aa4-43ad-9ac8-2de596087a35 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.167522 Jul 27 09:08:12.438501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 199/408] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:12 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:13.460789 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:13.461412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:13.468271 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:13.468790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:13.469617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:13.470046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:13.614605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:13.624016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:13.625537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:13.626743 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-707970e6-68aa-4ed1-b369-5a3e40080197 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.169822 Jul 27 09:08:13.627318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 210/409] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:13 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:14.654450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:14.655084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:14.661314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:14.661750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:14.662506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:14.662932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:14.803702 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:14.812790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:14.814294 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:14.815456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-105661f3-7fb8-4035-a5b0-095c917cc761 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.164864 Jul 27 09:08:14.816060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 200/410] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:14 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:15.839128 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:15.839763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:15.846316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:15.846763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:15.847535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:15.848004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:15.977260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:15.985736 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:15.987233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:15.988422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a09f5a61-eccd-422a-b848-9af8d136e2a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.153874 Jul 27 09:08:15.988992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 211/411] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:15 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:17.011458 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:17.012026 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:17.020005 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:17.020446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:17.021206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:17.021634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:17.107156 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:08:17.107618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:08:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:08:17.154025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:17.162605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:17.164257 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:17.165435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4d91e511-e7b3-48fe-9933-71341d5ed86f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.158266 Jul 27 09:08:17.165985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 201/412] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:17 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:18.188775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:18.189360 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:18.196464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:18.196908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:18.197688 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:18.198115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:18.328799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:18.337044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:18.338529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:18.339672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3e42be46-376a-4d9a-a510-a5303182752f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.154826 Jul 27 09:08:18.340242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 212/413] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:18 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:19.362413 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:19.362998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:19.369566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:19.370008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:19.370759 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:19.371183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:19.508057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:19.516742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:19.518215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:19.519372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-aa9405f6-fada-4755-a420-356c67423080 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.160886 Jul 27 09:08:19.519970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 202/414] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:19 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:20.543322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:20.543974 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:20.546335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=45 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:20.552381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:20.552828 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:20.553599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:20.554044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:20.688737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:20.690997 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:20.699417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:20.701002 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:20.702200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ee0fbdc1-dfe6-4e09-a58c-7cea62882d8e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.162788 Jul 27 09:08:20.702779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 213/415] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:20 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:21.725242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:21.726494 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:21.732893 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:21.733348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:21.734128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:21.734571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:21.784868 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-a4ec9561-3783-423a-95cf-615822e071f0 req-575f5e71-f9a6-40bd-9312-dd95afb8adb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "name": "network-vif-plugged", "status": "completed", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:21.798164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a4ec9561-3783-423a-95cf-615822e071f0 req-575f5e71-f9a6-40bd-9312-dd95afb8adb3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:21.798842 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a4ec9561-3783-423a-95cf-615822e071f0 req-575f5e71-f9a6-40bd-9312-dd95afb8adb3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:21.811011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-a4ec9561-3783-423a-95cf-615822e071f0 req-575f5e71-f9a6-40bd-9312-dd95afb8adb3 service nova] Creating event network-vif-plugged:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:08:21.817152 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-a4ec9561-3783-423a-95cf-615822e071f0 req-575f5e71-f9a6-40bd-9312-dd95afb8adb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035897 Jul 27 09:08:21.817935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 214/416] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:08:21.883684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:21.892510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:21.894029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:21.895172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-77f088aa-10f1-4831-bd37-eae96e7eaa08 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.174056 Jul 27 09:08:21.895817 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 203/417] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:21 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:22.919518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:22.920321 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:22.926530 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:22.926985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:22.927820 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:22.928323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:23.057757 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:23.066190 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:23.067726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:23.068960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ad75d579-8df3-42cc-827a-9cc1e640f509 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.154225 Jul 27 09:08:23.070092 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 215/418] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:22 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:24.093996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:24.094607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:24.101375 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:24.101826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:24.102601 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:24.103037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:24.241457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:24.250199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:24.251699 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:24.252884 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2673ac95-2ff1-45d1-9c40-36033c0adcb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1809 microversion: 2.20 time: 0.163021 Jul 27 09:08:24.253435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 204/419] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:24 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:08:24.798703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:24.799316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:24.806081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:24.806533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:24.807308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:24.807769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:24.890821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lazy-loading 'services' on Instance uuid 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:08:24.965993 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5bbefdc3-b951-4e89-b635-e7fab22e975b tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac/os-volume_attachments/2b636a9b-d765-4f30-bf87-052bafec5b6e" status: 202 len: 0 microversion: 2.1 time: 0.171036 Jul 27 09:08:24.966579 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 216/420] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:08:24 2022] DELETE /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac/os-volume_attachments/2b636a9b-d765-4f30-bf87-052bafec5b6e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:08:25.278806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:25.279409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:25.286029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:25.286419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:25.287183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:25.287617 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:25.415539 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:25.424288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:25.425981 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:25.427457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cff25aef-db4a-42c8-924f-f2f47d2009eb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1796 microversion: 2.20 time: 0.152589 Jul 27 09:08:25.428110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 205/421] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:08:25 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:08:26.088096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:26.088691 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:26.095074 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:26.095524 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:26.096369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:26.096810 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:26.125007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:08:26.201414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8c172dd6-58d1-4d05-986f-c736b0569e2a tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 204 len: 0 microversion: 2.1 time: 0.118121 Jul 27 09:08:26.201986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 217/422] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:08:26 2022] DELETE /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:08:26.210703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:26.211313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:26.213178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=36 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:26.218346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:26.218787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:26.219541 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:26.220032 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:26.356576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:26.364098 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e4d87bc7-c5e7-4a3c-8159-5ee7a34ec26c tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1515 microversion: 2.1 time: 0.157372 Jul 27 09:08:26.364669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 206/423] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:26 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:27.387582 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:27.388314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:27.394827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:27.395274 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:27.396069 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:27.396509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:27.527194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:27.534724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a148b313-2d1f-417c-998e-fb15ceb61baf tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1515 microversion: 2.1 time: 0.151580 Jul 27 09:08:27.535298 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 218/424] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:27 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:28.498862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-f9a82742-75be-4721-9f16-e995f948b18b req-2ae37eac-3ba4-452c-b798-217d7be0c8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ff6527-5aab-4bb4-a4f1-ba7edbe849ac", "name": "network-vif-deleted", "tag": "49e97a36-d01a-4d6a-b503-c27a97d036e1"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:28.509623 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f9a82742-75be-4721-9f16-e995f948b18b req-2ae37eac-3ba4-452c-b798-217d7be0c8ff service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:28.510072 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f9a82742-75be-4721-9f16-e995f948b18b req-2ae37eac-3ba4-452c-b798-217d7be0c8ff service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:28.521665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-f9a82742-75be-4721-9f16-e995f948b18b req-2ae37eac-3ba4-452c-b798-217d7be0c8ff service nova] Creating event network-vif-deleted:49e97a36-d01a-4d6a-b503-c27a97d036e1 for instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac on hv-cinder-79760 Jul 27 09:08:28.527130 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-f9a82742-75be-4721-9f16-e995f948b18b req-2ae37eac-3ba4-452c-b798-217d7be0c8ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Jul 27 09:08:28.527724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 207/425] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:28.557195 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:28.557807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:28.564335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:28.564785 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:28.565559 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:28.566162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:28.631664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e576003a74e0b9dc7463497d61cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4aed934a6a4fd6a8311bb3fd048d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:28.640239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-88d5d4b1-0fd0-4dc8-b38d-2fa98c413f62 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 200 len: 1304 microversion: 2.1 time: 0.087753 Jul 27 09:08:28.640918 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 219/426] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:28 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:29.663467 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:29.664198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] [instance: 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:29.670443 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:29.670895 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:29.671660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:29.672127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:29.676101 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=85 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:29.686556 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] HTTP exception thrown: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Request method failure captured: Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac HTTP/1.1 Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P_9QKkLc4PqxuiytXGhAg6iH74W2vjWIdtsDiWrSGZZnrUY0vk7SYBxHcQQcvX4rTGQPuIKYvdVX5EqYpWkKBvwksFfav2hfHeyw3moQGX9VE-Jpwg5HW-BuqnYM3oWbplgzMdGXD9utVS7bEuGxCzfbbW0BEsmUI413gyRBBN86pA Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 5b4aed934a6a4fd6a8311bb3fd048d4f Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:08:29.688224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b4aed934a6a4fd6a8311bb3fd048d4f"}]}] Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 5b4aed934a6a4fd6a8311bb3fd048d4f Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-524896930 Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesSnapshotTestJSON-524896930-project Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 4c3e576003a74e0b9dc7463497d61cd9 Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesSnapshotTestJSON-524896930-project Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. Jul 27 09:08:29.689612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '24ff6527-5aab-4bb4-a4f1-ba7edbe849ac'} Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:08:29.690503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. Jul 27 09:08:29.692199 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:29.694802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] Returning 404 to user: Instance 24ff6527-5aab-4bb4-a4f1-ba7edbe849ac could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:08:29.694802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-662f7e17-da22-46f9-8f6e-bc902f485151 tempest-VolumesSnapshotTestJSON-524896930 tempest-VolumesSnapshotTestJSON-524896930-project] 10.222.0.33 "GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac" status: 404 len: 111 microversion: 2.1 time: 0.031590 Jul 27 09:08:29.694802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 208/427] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:29 2022] GET /compute/v2.1/servers/24ff6527-5aab-4bb4-a4f1-ba7edbe849ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:08:33.814127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29631ec-699e-4b32-a628-d91f3c75b2ca"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:33.816654 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:33.823388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:33.823864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:33.824640 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:33.825075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:34.256847 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e2e325ab-04f5-42dd-a7f8-a04ba38b0ace tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445707 Jul 27 09:08:34.257418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 220/428] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:08:33 2022] POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:41.588269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:41.588852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:41.591235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=5 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:41.591883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:41.597826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.598268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.599039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.599470 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.623291 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-48b743a9-bce0-4c08-a9e7-bd4d46320c6f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/ips" status: 200 len: 150 microversion: 2.1 time: 0.039397 Jul 27 09:08:41.623862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 209/429] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:08:41 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:41.638012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f4eb991-bf69-4d4f-91d0-7573b49a4ee3"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:41.640623 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:41.646788 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.647232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.648027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.648468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.728259 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: POST /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/os-volume_attachments HTTP/1.1 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 74 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:08:41.730277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {"volumeAttachment": {"volumeId": "2f4eb991-bf69-4d4f-91d0-7573b49a4ee3"}} Jul 27 09:08:41.731899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'server_id': '35cc48c5-70ac-463e-98a8-0e4241df0ea6', 'body': {'volumeAttachment': {'volumeId': '2f4eb991-bf69-4d4f-91d0-7573b49a4ee3'}}} Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:41.732786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:41.734054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 400 to user: Invalid volume: volume 2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 is already attached to instances: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cd8fae2e-fb7f-40b0-ab77-716181ed618b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098984 Jul 27 09:08:41.735228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 221/430] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:08:41 2022] POST /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 09:08:41.741326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:41.741825 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:41.747921 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.748372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.749142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.749583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.775110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:08:41.851484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-025e03cf-7a54-41be-a514-199369861d60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 204 len: 0 microversion: 2.1 time: 0.114326 Jul 27 09:08:41.852097 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 210/431] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:08:41 2022] DELETE /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:08:41.860430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:41.861073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:41.868899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.869341 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:41.870100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:41.870964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:42.003777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:42.011981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-72a77739-9370-4cb2-949d-b13c63dadb11 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1682 microversion: 2.1 time: 0.155571 Jul 27 09:08:42.012573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 222/432] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:41 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:43.034714 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:43.035321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:43.041957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:43.042401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:43.043152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:43.043581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:43.174566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:43.182482 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6daadaa3-6c55-45ba-b38b-f548a950b315 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1682 microversion: 2.1 time: 0.152224 Jul 27 09:08:43.183064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 211/433] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:43 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:44.203571 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:44.204281 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:44.211577 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:44.212095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:44.212822 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:44.213339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:44.349207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:44.357443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1a5087b0-e8fd-44b7-a661-32026102b410 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1682 microversion: 2.1 time: 0.157912 Jul 27 09:08:44.358051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 223/434] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:44 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:44.993094 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:44.996379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:45.002893 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.003534 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.004531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.005134 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.032059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lazy-loading 'flavor' on Instance uuid 101d8a8d-3f58-4188-9418-feacb85a7388 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:08:45.168830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-11bd79a3-5c8e-4b85-955c-02c3fcd5f396 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/action" status: 200 len: 32 microversion: 2.1 time: 0.180943 Jul 27 09:08:45.169562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 212/435] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:08:44 2022] POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:08:45.181259 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:45.182548 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:45.192362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.192816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.194319 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.194771 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.381700 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:45.383126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:45.391242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.392139 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.392728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.393364 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.425610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:45.439037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-84055235-b85c-48bb-a32b-cbac36381a82 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.263573 Jul 27 09:08:45.439650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 224/436] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:45 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:45.481306 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:45.489731 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e89f9fdb-154b-485e-9f63-f9de7922396f tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 200 len: 1614 microversion: 2.1 time: 0.113001 Jul 27 09:08:45.490412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 213/437] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:45 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:45.729781 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-29737d23-a11f-45e4-b8e5-d0c366bee309 req-730742a5-b957-476e-ab16-a4a5059744f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cc48c5-70ac-463e-98a8-0e4241df0ea6", "name": "network-vif-deleted", "tag": "65536b71-1cb0-4ef5-b038-29a311492d3b"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:45.742704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-29737d23-a11f-45e4-b8e5-d0c366bee309 req-730742a5-b957-476e-ab16-a4a5059744f8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:45.743446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-29737d23-a11f-45e4-b8e5-d0c366bee309 req-730742a5-b957-476e-ab16-a4a5059744f8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:45.770325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-29737d23-a11f-45e4-b8e5-d0c366bee309 req-730742a5-b957-476e-ab16-a4a5059744f8 service nova] Creating event network-vif-deleted:65536b71-1cb0-4ef5-b038-29a311492d3b for instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 on hv-cinder-79760 Jul 27 09:08:45.777575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-29737d23-a11f-45e4-b8e5-d0c366bee309 req-730742a5-b957-476e-ab16-a4a5059744f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051343 Jul 27 09:08:45.778773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 225/438] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:46.461572 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:46.462648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:46.469724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:46.470419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:46.471219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:46.471646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:46.519124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:46.522203 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:46.539712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:46.540283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:46.541159 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:46.541675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:46.593705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 HTTP/1.1 Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:08:46.605386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:08:46.606704 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '35cc48c5-70ac-463e-98a8-0e4241df0ea6'} Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:08:46.607409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:08:46.608592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:08:46.609695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:08:46.609695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a5fa40f9-862e-4716-8113-93fedf06937b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 404 len: 111 microversion: 2.1 time: 0.099804 Jul 27 09:08:46.609695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 226/439] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:46 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:08:46.616980 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6d91bc70-fe82-4c18-b01a-a85fdfdf601e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '.version_select at 0x7f6f87e68c10>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:46.651454 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6d91bc70-fe82-4c18-b01a-a85fdfdf601e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009666668" status: 202 len: 0 microversion: 2.1 time: 0.038738 Jul 27 09:08:46.652982 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 227/440] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009666668 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:08:46.674060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:46.682763 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-46e98561-e6af-45ad-b69c-70eeeda11fbb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.225761 Jul 27 09:08:46.694142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 214/441] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:46 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:47.421700 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:47.422204 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:47.429908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.430053 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.430794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.431234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.516737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lazy-loading 'services' on Instance uuid 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:08:47.589614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-68a2b966-4baf-43bc-8f59-d8ee4b2d7b4b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments/2f4eb991-bf69-4d4f-91d0-7573b49a4ee3" status: 202 len: 0 microversion: 2.1 time: 0.171932 Jul 27 09:08:47.590226 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 228/442] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:08:47 2022] DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments/2f4eb991-bf69-4d4f-91d0-7573b49a4ee3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:08:47.599142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:47.601420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:47.608218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.608528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.609332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.609734 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.642697 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e3317269-a337-4c76-bc45-bffa0b54b574 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047893 Jul 27 09:08:47.643447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 215/443] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:08:47 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:47.705473 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:47.706102 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:47.712683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.713126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.713884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:47.714323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:47.716968 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:47.865784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:47.874227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0492d678-4c30-456f-865c-c7ce3eaf587f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.173133 Jul 27 09:08:47.875031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 229/444] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:47 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:48.657140 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:48.659351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:48.666571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.667016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.667810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.668246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.699905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-187c3e1c-b9f1-4904-81e8-aaa5f614b047 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046675 Jul 27 09:08:48.700486 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 216/445] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:08:48 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:08:48.768891 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:48.769924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:48.777601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.778519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.779843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.780420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.807248 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:08:48.895044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-960235f8-ba3c-4bc6-9b37-8fde77ed0bb7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 204 len: 0 microversion: 2.1 time: 0.130140 Jul 27 09:08:48.896059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 230/446] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:08:48 2022] DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:08:48.899770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:48.901034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:48.905681 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:48.906389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:48.909129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.909669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.910459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.910890 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.913783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.913920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:48.914664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:48.915408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:49.048845 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:49.057078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0aa435ba-193a-4cf0-b806-078f833df7c7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.164152 Jul 27 09:08:49.057759 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 217/447] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:48 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:49.061046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:49.069559 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-21666360-e672-4b66-8894-dd96725a39ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1684 microversion: 2.1 time: 0.168661 Jul 27 09:08:49.070212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 231/448] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:48 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:50.079360 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:50.079949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:50.088686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:50.090262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:50.090429 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:50.090556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:50.090965 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:50.091060 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:50.097513 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:50.097998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:50.098772 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:50.099241 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:50.224958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:50.233075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3d4e63db-fcb1-44b9-8c58-412cf40fbdd7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.157651 Jul 27 09:08:50.233650 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 218/449] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:50 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:50.266692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:50.274280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-26a28b7f-9929-40d1-ae59-37639b6d0d9b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1684 microversion: 2.1 time: 0.187556 Jul 27 09:08:50.274844 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 232/450] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:50 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:51.254595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:51.255129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:51.261939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:51.262387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:51.263167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:51.263621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:51.296260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:51.296948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:51.299661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:51.307222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:51.307968 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:51.308765 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:51.309207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:51.387474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:51.395394 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-14bdc0ae-6f25-486c-97fb-37c1218eb7db tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 200 len: 1616 microversion: 2.1 time: 0.103145 Jul 27 09:08:51.398979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:51.400860 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 233/451] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:51 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 1616 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:51.407281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4d838fd6-74fa-4a85-b07f-d37b861c5ed7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.156707 Jul 27 09:08:51.407864 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 219/452] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:51 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:51.470378 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-69c2c423-b9a8-4045-8ba5-6fc721d33b67 req-c82e43c5-e139-4ad2-ba4b-d9db194816f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c09eab3-aefe-4c50-b06c-46dfd39da7a6", "name": "network-vif-deleted", "tag": "aa7d95c2-ca1e-412b-b3b6-0de274e1bf29"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:51.482778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-69c2c423-b9a8-4045-8ba5-6fc721d33b67 req-c82e43c5-e139-4ad2-ba4b-d9db194816f6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:51.483244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-69c2c423-b9a8-4045-8ba5-6fc721d33b67 req-c82e43c5-e139-4ad2-ba4b-d9db194816f6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:51.496118 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-69c2c423-b9a8-4045-8ba5-6fc721d33b67 req-c82e43c5-e139-4ad2-ba4b-d9db194816f6 service nova] Creating event network-vif-deleted:aa7d95c2-ca1e-412b-b3b6-0de274e1bf29 for instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 on hv-cinder-79760 Jul 27 09:08:51.508136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-69c2c423-b9a8-4045-8ba5-6fc721d33b67 req-c82e43c5-e139-4ad2-ba4b-d9db194816f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038831 Jul 27 09:08:51.510079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 234/453] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:52.416913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:52.417544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:52.424487 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:52.424932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:52.425711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:52.426118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:52.430288 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:52.431157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:52.438520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:52.438987 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:52.439856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:52.440517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:52.441050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 HTTP/1.1 Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:08:52.443528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:08:52.445338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '0c09eab3-aefe-4c50-b06c-46dfd39da7a6'} Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:08:52.446255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:08:52.447454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:08:52.448542 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:08:52.448542 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-370b8bd7-b4b6-473f-8142-ef29e50f8f0b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 404 len: 111 microversion: 2.1 time: 0.032798 Jul 27 09:08:52.448542 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 220/454] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:52 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:08:52.454857 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-53dda283-7965-4e6c-a5b3-9ca62f73fc31 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '.version_select at 0x7f6f94819ee0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:52.476655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-53dda283-7965-4e6c-a5b3-9ca62f73fc31 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193852567" status: 202 len: 0 microversion: 2.1 time: 0.025647 Jul 27 09:08:52.480708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 221/455] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:08:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193852567 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:08:52.588622 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:52.597459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-99b0754e-b4e0-4eaf-bc82-5f6afeca3d28 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.171673 Jul 27 09:08:52.598073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 235/456] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:52 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:08:53.405722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fcb475bb-536b-4e23-99bd-34a9d7ca20f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: .version_select at 0x7f6f946a9430>, body: {"keypair": {"name": "tempest-keypair-1006816700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwJvUS6lVIujzdPxNdwzK7q7Ew5IWn8arIR6mhTWKp6/VWkoU2GBQoJmJHPAmsppbfCFjDdY4I20t0BllxJAcnB+dqcgaGFWPKmUpBul3QretaTLdDqNDkc5e5A/vpE7w=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:53.422205 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-fcb475bb-536b-4e23-99bd-34a9d7ca20f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:08:53.426107 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-fcb475bb-536b-4e23-99bd-34a9d7ca20f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:08:53.448908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fcb475bb-536b-4e23-99bd-34a9d7ca20f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047106 Jul 27 09:08:53.449516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 222/457] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:08:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:08:53.626964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:53.627727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:53.636884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:53.637658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:53.638885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:53.639543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:53.838630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:53.847441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fea9cd95-b687-441c-9e48-5bf7574ea4e7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.224762 Jul 27 09:08:53.861715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 236/458] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:53 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:54.870223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:54.872269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:54.879037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:54.879483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:54.880289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:54.881864 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:54.930694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-218470926", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "effe6ca8-c538-478b-abc9-f3d649387e81"}], "security_groups": [{"name": "tempest-securitygroup--320118401"}], "key_name": "tempest-keypair-1006816700", "user_data": "}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:08:55.032129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:55.040936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1cb9e612-a8d2-4ed3-b1f7-653289603c24 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.175805 Jul 27 09:08:55.042461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 223/459] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:54 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:55.048029 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] validate_networks() for [('effe6ca8-c538-478b-abc9-f3d649387e81', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:08:55.450875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:08:55.450875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:08:55.450875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:08:55.450875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:08:55.450875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:08:55.458366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:55.458937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:55.459785 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:55.460220 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:55.478232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:08:55.482503 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:08:55.501131 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:08:55.503410 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:08:55.554952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-39186273-3549-4e39-9871-7679dd64f660 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.629483 Jul 27 09:08:55.561515 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 237/460] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:08:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:08:55.567445 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e02e6c36-766a-41c2-875d-c3619192f708 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:55.568242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e02e6c36-766a-41c2-875d-c3619192f708 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:55.622936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e02e6c36-766a-41c2-875d-c3619192f708 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:55.629733 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e02e6c36-766a-41c2-875d-c3619192f708 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1241 microversion: 2.1 time: 0.066972 Jul 27 09:08:55.630898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 224/461] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:55 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:56.063395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:56.064034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:56.070627 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:56.071074 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:56.071876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:56.072320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:56.207929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:56.216080 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3c1c0a4f-d246-4bc8-9c61-956999851dc2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.157521 Jul 27 09:08:56.216650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 238/462] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:56 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:56.652046 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:56.654084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:56.663068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:56.664081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:56.666643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:56.667621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:56.747373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:56.751677 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:56.760952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-72f6a374-5b07-4fcd-860c-90780be9fc14 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1299 microversion: 2.1 time: 0.113078 Jul 27 09:08:56.774662 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 225/463] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:56 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:57.237263 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:57.237966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:57.245650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:57.246183 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:57.246965 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:57.247402 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:57.426272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:57.434423 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-77a08304-1705-4bc4-827c-8ab96b508a19 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.201044 Jul 27 09:08:57.435000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 239/464] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:57 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:57.782554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:57.783171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:57.791517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:57.792003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:57.792790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:57.793228 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:57.924078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:57.932043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-42fa5585-e4a6-471a-b343-10d03d9165f1 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.153395 Jul 27 09:08:57.932616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 226/465] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:57 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:58.456057 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:58.456670 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:58.463273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:58.463731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:58.464527 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:58.464968 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:58.601156 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:58.609316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ef771b5a-e562-41fb-981f-604c7c108e34 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.157178 Jul 27 09:08:58.609885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 240/466] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:58 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:58.953447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:58.954067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:58.961293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:58.961742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:58.962518 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:58.962961 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:59.090143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:59.097889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d51fba02-733b-4827-9e73-6e6586204fa8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.148330 Jul 27 09:08:59.098517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 227/467] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:58 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:08:59.631545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:08:59.632184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:08:59.640973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:59.641440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:59.642224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:08:59.642671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:08:59.854478 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:08:59.863069 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c4feb017-c1f7-460b-8cf1-3830602fa63b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.236079 Jul 27 09:08:59.863969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 241/468] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:08:59 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:00.121208 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:00.122450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:00.131137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:00.131940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:00.133057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:00.134321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:00.209260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-1ca8c2d0-f566-4f1b-b48f-5d4376f68202 req-bb353bfc-5b82-475e-9fb5-22bf3d2118ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df65d0e3-a3cb-4a90-85fa-257d141ea072", "tag": "af900191-366c-4d92-85de-51351e1d44cd"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:00.237738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-1ca8c2d0-f566-4f1b-b48f-5d4376f68202 req-bb353bfc-5b82-475e-9fb5-22bf3d2118ce service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:00.238483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-1ca8c2d0-f566-4f1b-b48f-5d4376f68202 req-bb353bfc-5b82-475e-9fb5-22bf3d2118ce service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:00.251496 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-1ca8c2d0-f566-4f1b-b48f-5d4376f68202 req-bb353bfc-5b82-475e-9fb5-22bf3d2118ce service nova] Creating event network-changed:af900191-366c-4d92-85de-51351e1d44cd for instance df65d0e3-a3cb-4a90-85fa-257d141ea072 on hv-cinder-79760 Jul 27 09:09:00.257380 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-1ca8c2d0-f566-4f1b-b48f-5d4376f68202 req-bb353bfc-5b82-475e-9fb5-22bf3d2118ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052395 Jul 27 09:09:00.258338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 242/469] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:00.317064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:00.326402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-517a0988-a884-4724-a5e9-1e1fe2642584 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.210040 Jul 27 09:09:00.327679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 228/470] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:00 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:00.886052 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:00.886751 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:00.893475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:00.893922 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:00.894686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:00.895122 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:01.023280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:01.031512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b65ac8f8-b029-4735-b7d8-27b0f592f41d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.149877 Jul 27 09:09:01.032134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 243/471] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:00 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:01.348521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:01.349714 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:01.356256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:01.356700 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:01.357464 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:01.357904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:01.486089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:01.493791 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f4a32525-f38e-432c-8475-d44d94d410e7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.149007 Jul 27 09:09:01.494532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 229/472] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:01 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:02.054046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:02.054659 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:02.061379 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:02.061903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:02.062748 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:02.063038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:02.207634 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:02.215678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f891cb35-f63e-4490-809a-256c3ea5ecc6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.166079 Jul 27 09:09:02.216312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 244/473] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:02 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:02.514866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:02.515605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:02.522728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:02.523212 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:02.524002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:02.524435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:02.663518 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:02.671077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-23dcce41-f113-4036-a2fb-9dd2d1ed0366 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.160002 Jul 27 09:09:02.671641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 230/474] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:02 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:03.236898 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:03.237504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:03.244374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:03.244835 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:03.245619 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:03.246061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:03.375972 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:03.385497 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-34e84079-936a-49df-a534-406a0562d9ef tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.152420 Jul 27 09:09:03.386079 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 245/475] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:03 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:03.693228 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:03.693851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:03.700388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:03.700840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:03.701612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:03.702048 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:03.837781 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:03.845288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a72e4cf2-4fd4-4279-a9b8-f77a15d69659 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.156366 Jul 27 09:09:03.845854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 231/476] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:03 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:04.407672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:04.408428 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:04.415006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:04.415455 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:04.416275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:04.416758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:04.419392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:04.554210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:04.562161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4f5fb923-3138-4d87-96cc-fb4d896de0d2 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.158555 Jul 27 09:09:04.562732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 246/477] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:04 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:04.866854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:04.867554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:04.874016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:04.874456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:04.876995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:04.876995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:05.007478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:05.015474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0d5e4eb4-0070-4f61-b4dd-bf634ec0d59b tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.153075 Jul 27 09:09:05.016133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 232/478] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:04 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:05.583606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:05.584408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:05.586849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:05.587589 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:05.594086 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:05.594796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:05.595825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:05.596271 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:05.685211 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-f8429cc8-1424-436a-a1bd-076a7ff02b41 req-8c321748-3969-41bd-80e6-96b5d1c7c712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df65d0e3-a3cb-4a90-85fa-257d141ea072", "name": "network-vif-plugged", "status": "completed", "tag": "af900191-366c-4d92-85de-51351e1d44cd"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:05.696411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=6 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:05.699273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f8429cc8-1424-436a-a1bd-076a7ff02b41 req-8c321748-3969-41bd-80e6-96b5d1c7c712 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:05.699886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f8429cc8-1424-436a-a1bd-076a7ff02b41 req-8c321748-3969-41bd-80e6-96b5d1c7c712 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:05.712649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-f8429cc8-1424-436a-a1bd-076a7ff02b41 req-8c321748-3969-41bd-80e6-96b5d1c7c712 service nova] Creating event network-vif-plugged:af900191-366c-4d92-85de-51351e1d44cd for instance df65d0e3-a3cb-4a90-85fa-257d141ea072 on hv-cinder-79760 Jul 27 09:09:05.718048 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-f8429cc8-1424-436a-a1bd-076a7ff02b41 req-8c321748-3969-41bd-80e6-96b5d1c7c712 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044349 Jul 27 09:09:05.718756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 233/479] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:09:05.743414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:05.753890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a38bd46f-32eb-458a-8149-f3c5a0b7b511 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.174660 Jul 27 09:09:05.754683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 247/480] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:05 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:06.038109 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:06.038812 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:06.045380 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.045816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.046578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.047007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.175559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:06.182967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a1046bfb-31cd-4d45-825e-b8ed291c9b0c tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.149566 Jul 27 09:09:06.183526 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 234/481] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:06 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:06.779070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:06.779686 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:06.787366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.787850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.789471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.790103 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.851635 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:06.852165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:06.858255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.858706 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.859479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.859947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.893425 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-101b65e3-3657-4abb-9bfb-927f4c4989c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments/155b7530-6e09-4817-953d-df4f30e05e7f" status: 200 len: 194 microversion: 2.20 time: 0.046357 Jul 27 09:09:06.894033 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 235/482] 10.222.0.33 () {60 vars in 1454 bytes} [Wed Jul 27 09:09:06 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments/155b7530-6e09-4817-953d-df4f30e05e7f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 09:09:06.921670 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:06.929876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-339780c0-a9d9-4058-8a12-362250f0013b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.154889 Jul 27 09:09:06.930534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 248/483] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:06 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:06.963122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:06.963612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:06.969709 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.970150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:06.970904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:06.971331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.092429 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lazy-loading 'services' on Instance uuid 20213da7-326f-41bd-b775-0fb7238203e9 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:09:07.204920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:07.205203 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-be165e46-b9fb-4118-87e4-8191ce9b7dec tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments/155b7530-6e09-4817-953d-df4f30e05e7f" status: 202 len: 0 microversion: 2.20 time: 0.245832 Jul 27 09:09:07.205448 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:07.205806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 236/484] 10.222.0.33 () {60 vars in 1457 bytes} [Wed Jul 27 09:09:06 2022] DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments/155b7530-6e09-4817-953d-df4f30e05e7f => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:09:07.212230 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.212682 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.213459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.213895 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.214947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:07.217290 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:07.223704 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.224174 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.224945 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.225379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.255497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4e0c9cec-52ce-4f47-ba68-121b9304cf28 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044070 Jul 27 09:09:07.256108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 237/485] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Jul 27 09:09:07 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 09:09:07.346795 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:07.354212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-67821f91-2637-4739-80cf-6738e0ed2171 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1366 microversion: 2.1 time: 0.153334 Jul 27 09:09:07.354777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 249/486] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:07 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:09:07.951512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:07.952073 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:07.958062 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.958501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:07.959250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:07.959676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.095114 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:08.104987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1280c567-9a90-4c40-8520-a9a8db4efa08 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.157335 Jul 27 09:09:08.105615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 238/487] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:07 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:08.268538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:08.270636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:08.277735 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.278193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.278976 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.279834 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.320967 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e490870f-5673-4cb8-8acf-3429b1ea7bfa tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056453 Jul 27 09:09:08.321857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 250/488] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Jul 27 09:09:08 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:09:08.375385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:08.376037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:08.382819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.383273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.384350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.384786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.523775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:08.537971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8ab66db9-134d-4ca9-9dd7-939f5b8130d2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1557 microversion: 2.1 time: 0.166311 Jul 27 09:09:08.538558 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 239/489] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:08 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:08.558157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:08.558652 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:08.564700 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.565142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.565897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:08.566326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:08.657529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6f483690-9efb-4b28-bbbf-3bf077ed51dd tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103174 Jul 27 09:09:08.658128 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 251/490] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:09:08 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:09.127493 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:09.128293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:09.136582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:09.137149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:09.137812 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:09.138246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:09.334595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:09.336923 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:09.343531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:09.343890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:09.344751 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:09.345071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:09.391927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:09.395177 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c16d61fb-c0cd-44a6-92b1-0226fb7c48a8 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059405 Jul 27 09:09:09.402927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 252/491] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Jul 27 09:09:09 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 09:09:09.406464 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c982be6a-2a54-47b7-8c5c-6075ea918a70 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1737 microversion: 2.1 time: 0.283815 Jul 27 09:09:09.407367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 240/492] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:09 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:09.959857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-a6582015-0775-4e62-8b56-eac420db83a8 req-2e372adb-a639-470c-9731-585ad766131b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df65d0e3-a3cb-4a90-85fa-257d141ea072", "tag": "af900191-366c-4d92-85de-51351e1d44cd"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:09.969081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a6582015-0775-4e62-8b56-eac420db83a8 req-2e372adb-a639-470c-9731-585ad766131b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:09.969526 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a6582015-0775-4e62-8b56-eac420db83a8 req-2e372adb-a639-470c-9731-585ad766131b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:09.980600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-a6582015-0775-4e62-8b56-eac420db83a8 req-2e372adb-a639-470c-9731-585ad766131b service nova] Creating event network-changed:af900191-366c-4d92-85de-51351e1d44cd for instance df65d0e3-a3cb-4a90-85fa-257d141ea072 on hv-cinder-79760 Jul 27 09:09:09.985653 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-a6582015-0775-4e62-8b56-eac420db83a8 req-2e372adb-a639-470c-9731-585ad766131b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030065 Jul 27 09:09:09.986258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 253/493] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:10.411377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:10.414655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:10.421827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.422384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.423322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.423877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.429626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:10.432297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:10.445068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.445814 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.446778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.447363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.457796 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-67e1ea8f-cb3b-48c1-966e-f05b14054971 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050969 Jul 27 09:09:10.458885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 241/494] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Jul 27 09:09:10 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:09:10.534281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:10.535056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:10.541838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.542285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.543051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.543928 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.564769 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:10.569646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:09:10.678037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1e7d8965-6aa4-4efb-aa35-18063cdcb27e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 204 len: 0 microversion: 2.20 time: 0.147305 Jul 27 09:09:10.679438 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 242/495] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Jul 27 09:09:10 2022] DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 09:09:10.689047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:10.690429 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:10.698474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.699117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.700000 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:10.700708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:10.845070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:10.853818 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:10.855313 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:10.856581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-638abc67-9e2a-4acf-8568-5e65552f02b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.172308 Jul 27 09:09:10.860119 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 243/496] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:10 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:10.937745 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:10.946500 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3d8e9a02-ffe9-421d-89aa-99fed77c8a94 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1717 microversion: 2.1 time: 0.521816 Jul 27 09:09:10.947075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 254/497] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:10 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1717 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:11.064762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:11.065258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:11.072078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.072533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.073310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.073750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.156467 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] HTTP exception thrown: Cannot 'detach_volume' instance 101d8a8d-3f58-4188-9418-feacb85a7388 while it is in vm_state rescued Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Request method failure captured: Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments/f29631ec-699e-4b32-a628-d91f3c75b2ca HTTP/1.1 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-7-iJrST1KTh6rFdPReTUtzFOhnJwCqmKmOQ7sjK_SuSrQR6GVqwr2dWXE9kuH7mF3IezmYxX3c8B3q5wGtEib6CE4Dm7DBLIcG6uj4-qq87DlLaa4rM7nHrSKLxh52r_DnQECbWeH3PvguFBSR_cuOwnh_ATMexGSbDnN-9taDo8 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:09:11.158023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91b6498ed874b4cac422867319642bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91b6498ed874b4cac422867319642bb"}]}] Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: c0b38d0f4f5a4127bc908e07a6629342 Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:09:11.159563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Cannot 'detach_volume' instance 101d8a8d-3f58-4188-9418-feacb85a7388 while it is in vm_state rescued Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'server_id': '101d8a8d-3f58-4188-9418-feacb85a7388', 'id': 'f29631ec-699e-4b32-a628-d91f3c75b2ca'} Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:09:11.163722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 101d8a8d-3f58-4188-9418-feacb85a7388 while it is in vm_state rescued Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 101d8a8d-3f58-4188-9418-feacb85a7388 while it is in vm_state rescued Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:11.165152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Returning 409 to user: Cannot 'detach_volume' instance 101d8a8d-3f58-4188-9418-feacb85a7388 while it is in vm_state rescued {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:09:11.166110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f3c40ad3-1b8a-426e-b6f6-3ab0cdec639e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments/f29631ec-699e-4b32-a628-d91f3c75b2ca" status: 409 len: 152 microversion: 2.1 time: 0.098773 Jul 27 09:09:11.166110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 244/498] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:09:11 2022] DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments/f29631ec-699e-4b32-a628-d91f3c75b2ca => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 09:09:11.168392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:11.168932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:11.176109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.176109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.177144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.177307 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.246615 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c4300cef-b85c-4928-b031-10906a7817d6 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/action" status: 202 len: 0 microversion: 2.1 time: 0.081918 Jul 27 09:09:11.247253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 255/499] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:09:11 2022] POST /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:09:11.256192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:11.256801 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:11.260165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:11.265062 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.265512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.266293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.266719 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.397527 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:11.405553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2934ed70-bb75-4d2c-a8a7-b82719b0b27b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1725 microversion: 2.1 time: 0.153804 Jul 27 09:09:11.406119 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 245/500] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:11 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:11.885459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:11.886167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:11.893323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.893762 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:11.894539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:11.894967 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:12.034666 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:12.043285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:12.044841 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:12.046252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-542aefa7-293c-41fe-8d62-58a31b7aa278 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1724 microversion: 2.20 time: 0.170403 Jul 27 09:09:12.046823 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 256/501] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:11 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:12.426522 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:12.427133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:12.433789 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:12.434239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:12.435017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:12.435456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:12.673707 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:12.686824 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7bd02dd7-563d-4f90-a289-9a134198bdda tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1725 microversion: 2.1 time: 0.264168 Jul 27 09:09:12.687785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 246/502] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:12 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:13.069385 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:13.069921 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:13.077244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:13.077910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:13.078865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:13.079487 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:13.092437 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-6db15b55-8fc2-47a4-9f74-c6e8ac933945 req-7359ba57-fcc0-4f20-acd5-55083c7bdc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20213da7-326f-41bd-b775-0fb7238203e9", "name": "network-vif-deleted", "tag": "84e37b58-cfd1-4d00-a208-9384f9af392b"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:13.102358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-6db15b55-8fc2-47a4-9f74-c6e8ac933945 req-7359ba57-fcc0-4f20-acd5-55083c7bdc3e service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:13.102807 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-6db15b55-8fc2-47a4-9f74-c6e8ac933945 req-7359ba57-fcc0-4f20-acd5-55083c7bdc3e service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:13.115417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-6db15b55-8fc2-47a4-9f74-c6e8ac933945 req-7359ba57-fcc0-4f20-acd5-55083c7bdc3e service nova] Creating event network-vif-deleted:84e37b58-cfd1-4d00-a208-9384f9af392b for instance 20213da7-326f-41bd-b775-0fb7238203e9 on hv-cinder-79760 Jul 27 09:09:13.120447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-6db15b55-8fc2-47a4-9f74-c6e8ac933945 req-7359ba57-fcc0-4f20-acd5-55083c7bdc3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Jul 27 09:09:13.121378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 247/503] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:13.151902 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:13.161199 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:13.162720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:13.163983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f4202f56-64df-48e1-9075-7996cf042c2a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1656 microversion: 2.20 time: 0.099071 Jul 27 09:09:13.164712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 257/504] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:13 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:13.709910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:13.710614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:13.716876 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:13.717331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:13.718141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:13.718578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:13.858813 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:13.866959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2899ca07-e930-4ee8-8cb6-07311841a1b3 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1725 microversion: 2.1 time: 0.162482 Jul 27 09:09:13.867536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 248/505] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:13 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:14.187295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:14.188126 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:14.195286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:14.195736 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:14.196538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:14.196979 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:14.229687 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:14.230054 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:14.230508 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lazy-loading 'fault' on Instance uuid 20213da7-326f-41bd-b775-0fb7238203e9 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:09:14.275479 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:14.284363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:14.285870 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:14.287035 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-793ef4ad-733a-4efb-8c87-ad692ea5915b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 200 len: 1371 microversion: 2.20 time: 0.103693 Jul 27 09:09:14.287593 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 258/506] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:14 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:09:14.888616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:14.889227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:14.896281 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:14.896723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:14.897491 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:14.897926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:15.028449 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:15.036977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-75790ccf-009b-4ebe-8996-02c809664d27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1731 microversion: 2.1 time: 0.152274 Jul 27 09:09:15.037545 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 249/507] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:14 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:15.057488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:15.058003 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:15.064119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:15.064570 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:15.065339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:15.065779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:15.143769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ee01eead-3b7f-4511-869c-2c4536c28a61 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090048 Jul 27 09:09:15.144375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 259/508] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:09:15 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:15.309903 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:15.310500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:15.316441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:15.316879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:15.317642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:15.318068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:15.332827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 HTTP/1.1 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:09:15.334478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:09:15.336191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '20213da7-326f-41bd-b775-0fb7238203e9'} Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:09:15.337027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:09:15.338239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:09:15.339317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:09:15.339317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8fa602f0-cf80-49c2-9318-0c61e3f9f613 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 404 len: 111 microversion: 2.20 time: 0.029847 Jul 27 09:09:15.339317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 250/509] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:15 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 09:09:15.345542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-748a0cff-7b21-4cd0-ae9a-5f466090f14d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '.version_select at 0x7f6f87dd1790>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:15.365683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-748a0cff-7b21-4cd0-ae9a-5f466090f14d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495678746" status: 204 len: 0 microversion: 2.20 time: 0.024422 Jul 27 09:09:15.366277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 260/510] 10.222.0.33 () {60 vars in 1259 bytes} [Wed Jul 27 09:09:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495678746 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 09:09:16.027065 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-47cdd314-8631-4fa8-94a7-914cc37ee14c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: .version_select at 0x7f6f946faaf0>, body: {"keypair": {"name": "tempest-keypair-1592258570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAHI+dUDvBdYbWaZ6++n180rJg5bUvO4oFkb3asKSckH8AwODwxgvl7Hfi9jupsvtQvCJJ7F4NX5ywWCOA1peOb0LPsedeBVcgX8Mp+1OssKANNZEzoIVJp5EMsazyshQ=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:16.043540 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-47cdd314-8631-4fa8-94a7-914cc37ee14c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for project cebf61d3bcd54689abcd1334772bfa51. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:09:16.049776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-47cdd314-8631-4fa8-94a7-914cc37ee14c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for user d793017cc53946bf91738acf42a6483c and project cebf61d3bcd54689abcd1334772bfa51. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:09:16.062016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-91d16278-8db3-4186-a797-2b32d1646222 req-492d9e75-d740-4162-a682-f4f87bceaf97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:16.080703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-91d16278-8db3-4186-a797-2b32d1646222 req-492d9e75-d740-4162-a682-f4f87bceaf97 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:16.081827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-91d16278-8db3-4186-a797-2b32d1646222 req-492d9e75-d740-4162-a682-f4f87bceaf97 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:16.083311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-47cdd314-8631-4fa8-94a7-914cc37ee14c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059445 Jul 27 09:09:16.084119 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 251/511] 10.222.0.33 () {62 vars in 1200 bytes} [Wed Jul 27 09:09:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 09:09:16.094922 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-91d16278-8db3-4186-a797-2b32d1646222 req-492d9e75-d740-4162-a682-f4f87bceaf97 service nova] Creating event network-changed:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:09:16.100973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-91d16278-8db3-4186-a797-2b32d1646222 req-492d9e75-d740-4162-a682-f4f87bceaf97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044083 Jul 27 09:09:16.101857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 261/512] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:17.705480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-742690894", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45ea829-27af-4d37-a6b1-f004b13d60c3"}], "security_groups": [{"name": "tempest-securitygroup--1924090314"}], "key_name": "tempest-keypair-1592258570", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:17.809100 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] validate_networks() for [('d45ea829-27af-4d37-a6b1-f004b13d60c3', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:09:18.117434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-b842e4b2-9b1c-4156-84a6-b23e9bf9c7fa req-8dddcb51-4cc5-433d-99a0-9c6a6fa8f3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:18.127490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b842e4b2-9b1c-4156-84a6-b23e9bf9c7fa req-8dddcb51-4cc5-433d-99a0-9c6a6fa8f3fb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:18.127963 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b842e4b2-9b1c-4156-84a6-b23e9bf9c7fa req-8dddcb51-4cc5-433d-99a0-9c6a6fa8f3fb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:18.139738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-b842e4b2-9b1c-4156-84a6-b23e9bf9c7fa req-8dddcb51-4cc5-433d-99a0-9c6a6fa8f3fb service nova] Creating event network-changed:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:09:18.144773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-b842e4b2-9b1c-4156-84a6-b23e9bf9c7fa req-8dddcb51-4cc5-433d-99a0-9c6a6fa8f3fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Jul 27 09:09:18.145598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 262/513] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:09:18.188881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:09:18.189296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:09:18.189758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:09:18.190183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:09:18.190592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:09:18.199856 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:18.200292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:18.201086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:18.201516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:18.218744 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for project cebf61d3bcd54689abcd1334772bfa51. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:09:18.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Getting quotas for user d793017cc53946bf91738acf42a6483c and project cebf61d3bcd54689abcd1334772bfa51. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:09:18.233944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:09:18.236252 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:09:18.284397 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-144040fc-7921-4450-b5e1-e33c2eca7986 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.583839 Jul 27 09:09:18.285202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 252/514] 10.222.0.33 () {62 vars in 1188 bytes} [Wed Jul 27 09:09:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 09:09:18.296466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:18.297165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:18.355368 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:18.364649 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:18.366213 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:18.367384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9cd036f2-1714-461a-842b-4179c3c80c54 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1281 microversion: 2.20 time: 0.075220 Jul 27 09:09:18.368170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 263/515] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:18 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:09:19.391370 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:19.392018 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:19.399676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:19.400151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:19.400926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:19.401595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:19.475101 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:19.484807 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:19.486752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:19.487915 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fcf617d2-6f13-4d7c-b676-f6c3d8cfa5b1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1351 microversion: 2.20 time: 0.101296 Jul 27 09:09:19.488457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 253/516] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:19 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:20.510825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:20.511561 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:20.519452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:20.519868 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:20.520975 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:20.521764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:20.678375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:20.688605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:20.690608 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:20.692599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6e37c06e-3464-4846-aa4c-9f2734793356 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.185350 Jul 27 09:09:20.698661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 264/517] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:20 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:21.032779 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-2211c4b5-1436-453e-9222-1de40e5efdb2 req-52c47937-ff4b-483c-882e-18d05822006c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:21.045940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2211c4b5-1436-453e-9222-1de40e5efdb2 req-52c47937-ff4b-483c-882e-18d05822006c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:21.046363 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2211c4b5-1436-453e-9222-1de40e5efdb2 req-52c47937-ff4b-483c-882e-18d05822006c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:21.062155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-2211c4b5-1436-453e-9222-1de40e5efdb2 req-52c47937-ff4b-483c-882e-18d05822006c service nova] Creating event network-changed:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:09:21.070653 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-2211c4b5-1436-453e-9222-1de40e5efdb2 req-52c47937-ff4b-483c-882e-18d05822006c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 Jul 27 09:09:21.071265 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 254/518] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:21.716377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:21.717027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:21.719452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:21.724983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:21.725432 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:21.726207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:21.726646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:21.854695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:21.862544 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:21.864618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:21.865729 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ab73c619-e366-4e8b-aa40-e509c53279ed tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.153285 Jul 27 09:09:21.866293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 265/519] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:21 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:22.890072 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:22.890767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:22.897646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:22.898095 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:22.898865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:22.899300 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:23.028672 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:23.036841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:23.038331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:23.039416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-32f3b0ac-44a8-4833-91d5-f62e44645e29 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.154161 Jul 27 09:09:23.040009 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 255/520] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:22 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:24.062730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:24.063344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:24.071436 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:24.072140 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:24.073138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:24.073821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:24.076696 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:24.205256 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:24.213276 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:24.214783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:24.215926 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-66fdc426-9e36-4674-91b0-288feca500c7 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.157787 Jul 27 09:09:24.216500 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 266/521] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:24 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:09:25.238657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:25.239299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:25.246065 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:25.246520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:25.247299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:25.247736 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:25.375337 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:25.384634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:25.386141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:25.387258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7a3ca16b-76f8-4eab-83ce-4d4cee4aa948 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.152563 Jul 27 09:09:25.387837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 256/522] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:25 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:25.806427 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-21311cc2-74fe-42b3-95c5-ec07c3f6680c req-d65bf152-5427-46df-8676-9add571cb5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "name": "network-vif-plugged", "status": "completed", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:25.816972 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-21311cc2-74fe-42b3-95c5-ec07c3f6680c req-d65bf152-5427-46df-8676-9add571cb5cb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:25.817437 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-21311cc2-74fe-42b3-95c5-ec07c3f6680c req-d65bf152-5427-46df-8676-9add571cb5cb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:25.828514 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-21311cc2-74fe-42b3-95c5-ec07c3f6680c req-d65bf152-5427-46df-8676-9add571cb5cb service nova] Creating event network-vif-plugged:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:09:25.833486 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-21311cc2-74fe-42b3-95c5-ec07c3f6680c req-d65bf152-5427-46df-8676-9add571cb5cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Jul 27 09:09:25.834012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 267/523] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:09:26.409540 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:26.410229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:26.417330 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:26.417775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:26.418541 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:26.418970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:26.552986 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:26.561343 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:26.563325 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:26.564696 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-891a3139-8e01-4bd2-8932-ce9232e376a1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1407 microversion: 2.20 time: 0.158948 Jul 27 09:09:26.565318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 257/524] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:26 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:27.589272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:27.590065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:27.596576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:27.597023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:27.598431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:27.598872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:27.737309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:27.745289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:27.746806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:27.747991 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5ac3baea-ae68-445a-ab68-5a3d87520bc9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1599 microversion: 2.20 time: 0.163591 Jul 27 09:09:27.748549 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 268/525] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:09:27 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:09:27.770891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:27.771402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:27.777923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:27.778368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:27.779137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:27.779574 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:27.855479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0bcf6628-c772-4e6d-b153-d4be9098730f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088922 Jul 27 09:09:27.856115 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 258/526] 10.222.0.33 () {60 vars in 1316 bytes} [Wed Jul 27 09:09:27 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 09:09:28.775721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-b6125bd4-e7b2-400c-b12d-d90b867d0f41 req-dd553c68-306a-4a3b-b9be-5381bf9984f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:28.780659 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:28.787922 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b6125bd4-e7b2-400c-b12d-d90b867d0f41 req-dd553c68-306a-4a3b-b9be-5381bf9984f7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:28.788374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b6125bd4-e7b2-400c-b12d-d90b867d0f41 req-dd553c68-306a-4a3b-b9be-5381bf9984f7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:28.799180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-b6125bd4-e7b2-400c-b12d-d90b867d0f41 req-dd553c68-306a-4a3b-b9be-5381bf9984f7 service nova] Creating event network-changed:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:09:28.804959 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-b6125bd4-e7b2-400c-b12d-d90b867d0f41 req-dd553c68-306a-4a3b-b9be-5381bf9984f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Jul 27 09:09:28.805574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 269/527] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:45.084650 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:45.085342 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=10 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:45.086716 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:45.087418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:45.091899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:45.092387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:45.101029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:45.101497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:45.102299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:45.102735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:45.128484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3fc99e34-c00d-4ff2-85d3-09f7b1443201 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/ips" status: 200 len: 151 microversion: 2.1 time: 0.044620 Jul 27 09:09:45.129057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 259/528] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:09:45 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:46.453490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae725e8-7814-4a8f-9aa1-9bc56410438a"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:46.455970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:46.458683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=9 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:46.459376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=15 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:46.465489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:46.465940 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:46.466708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:46.467149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:46.869108 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b6f843e7-f1b8-4760-99da-58b0a04514a5 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419827 Jul 27 09:09:46.869738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 270/529] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:09:46 2022] POST /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:48.448964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:48.449487 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:48.455907 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:48.456350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:48.457107 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:48.457661 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:48.603457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lazy-loading 'services' on Instance uuid 101d8a8d-3f58-4188-9418-feacb85a7388 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:09:48.674252 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f16e7016-535e-4cbd-9cc9-7a7bc2ca6f48 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments/f29631ec-699e-4b32-a628-d91f3c75b2ca" status: 202 len: 0 microversion: 2.1 time: 0.229075 Jul 27 09:09:48.675037 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 260/530] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:09:48 2022] DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments/f29631ec-699e-4b32-a628-d91f3c75b2ca => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:09:48.685422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:48.688028 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:48.694575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:48.695028 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:48.695844 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:48.696326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:48.730933 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d890d911-b7c5-48f8-8471-75a5581782d1 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051093 Jul 27 09:09:48.731496 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 271/531] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:48 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:49.743877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:49.746224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:49.753571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:49.754017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:49.754784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:49.755222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:49.783989 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3d7e29aa-be9f-43a5-ab0f-22f4d92e1428 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Jul 27 09:09:49.785149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 261/532] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:49 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:50.797114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:50.799242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:50.806308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:50.806753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:50.807516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:50.807976 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:50.836174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-63d3d7dc-1d88-49f8-a287-7d1cac7ac157 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jul 27 09:09:50.836799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 272/533] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:50 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:09:51.850253 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:51.852500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:51.859718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:51.860189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:51.860969 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:51.861411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:51.890747 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-18695294-6e58-4e59-b90b-28ca47289a4d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 Jul 27 09:09:51.891315 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 262/534] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:51 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:52.903633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:52.905949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:52.913435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:52.913947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:52.914817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:52.915284 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:52.945964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bcc2b22d-bc45-426f-ac8b-e6730db8e4e9 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Jul 27 09:09:52.946447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 273/535] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:52 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:53.959232 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:53.962108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:53.970101 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:53.970767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:53.972341 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:53.972881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.005548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-de632539-01d4-4ae9-b83e-94a69fec5392 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050925 Jul 27 09:09:54.006156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 263/536] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:53 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:09:54.083657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:54.084261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:54.090672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.091117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.091918 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.092351 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.118025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:09:54.195364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-32112e75-050a-4048-9dc9-d85a69d3e164 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 204 len: 0 microversion: 2.1 time: 0.115936 Jul 27 09:09:54.195987 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 274/537] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:09:54 2022] DELETE /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:09:54.205075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:54.205715 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:54.212516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.212908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.213679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.214120 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.349144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:54.356456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7db74747-f169-4e07-a04f-cbd4c792a076 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1691 microversion: 2.1 time: 0.155349 Jul 27 09:09:54.357026 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 264/538] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:54 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:54.401451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae725e8-7814-4a8f-9aa1-9bc56410438a"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:54.403907 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:54.409867 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.410313 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.411076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.411500 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.494283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: POST /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments HTTP/1.1 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 74 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:09:54.496066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {"volumeAttachment": {"volumeId": "3ae725e8-7814-4a8f-9aa1-9bc56410438a"}} Jul 27 09:09:54.497482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'server_id': 'df65d0e3-a3cb-4a90-85fa-257d141ea072', 'body': {'volumeAttachment': {'volumeId': '3ae725e8-7814-4a8f-9aa1-9bc56410438a'}}} Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:09:54.498289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:09:54.500076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 400 to user: Invalid volume: volume 3ae725e8-7814-4a8f-9aa1-9bc56410438a is already attached to instances: df65d0e3-a3cb-4a90-85fa-257d141ea072 {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0e13fa5d-e66d-4d55-916a-707fd94bfec9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100473 Jul 27 09:09:54.501550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 275/539] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:09:54 2022] POST /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:09:54.572056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:54.572553 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:54.578509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.578953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.579712 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.580175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.662292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lazy-loading 'services' on Instance uuid df65d0e3-a3cb-4a90-85fa-257d141ea072 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:09:54.735218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6306f612-1d17-4c13-ab1e-c198a9bb8a0d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments/3ae725e8-7814-4a8f-9aa1-9bc56410438a" status: 202 len: 0 microversion: 2.1 time: 0.166894 Jul 27 09:09:54.735735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 265/540] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:09:54 2022] DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments/3ae725e8-7814-4a8f-9aa1-9bc56410438a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:09:54.744536 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:54.746724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:54.753516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.754044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.754882 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:54.755317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:54.784302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7b1fe3e8-7738-416a-8e85-9f446a12e000 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Jul 27 09:09:54.784850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 276/541] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:54 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:09:55.379419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:55.380128 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:55.386620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:55.387055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:55.387834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:55.388261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:55.516797 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:55.524800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f7f0c170-3a0c-4322-b77a-ff7eb61218bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1691 microversion: 2.1 time: 0.150798 Jul 27 09:09:55.525369 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 266/542] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:55 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:55.898208 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:55.900388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:55.906693 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:55.907151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:55.907958 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:55.908401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:55.940973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e5320aed-535b-4cb7-b175-c0bf8191e785 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148799 Jul 27 09:09:55.941549 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 277/543] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:55 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:56.546865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:56.547530 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:56.554609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:56.555051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:56.555824 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:56.556254 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:56.697621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:56.705257 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4fcd5439-d4a9-4534-96e5-365a3ccfe444 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1691 microversion: 2.1 time: 0.162323 Jul 27 09:09:56.706415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 267/544] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:56 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:56.953416 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:56.955602 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:56.962732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:56.963180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:56.963977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:56.964418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:56.993670 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-777689b7-d6e3-4b7b-9a00-623c7e36b229 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Jul 27 09:09:56.994233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 278/545] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:56 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:57.727618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:57.728263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:57.734755 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:57.735198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:57.735999 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:57.736433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:57.948025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:57.957532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a83c8b2d-ee34-4772-ac0e-7e17bc68b18b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1691 microversion: 2.1 time: 0.234138 Jul 27 09:09:57.958312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 268/546] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:57 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:58.006964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:58.009764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:58.017060 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.017590 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.018587 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.019087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.048742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a22b7df0-5e7a-4669-b1a6-a0aca3da77a0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046730 Jul 27 09:09:58.049668 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 279/547] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:09:58 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:09:58.112524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:58.113033 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:58.118946 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.119388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.120180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.121142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.145717 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:09:58.223868 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-39ba7af3-16bb-48ec-8178-ea62f04ea927 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 204 len: 0 microversion: 2.1 time: 0.114342 Jul 27 09:09:58.224844 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 269/548] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:09:58 2022] DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:09:58.233391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:58.234008 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:58.240780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.241253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.242025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.242459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.373556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:58.381374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fb810871-e714-42ef-b3e5-d45094c2c52e tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1682 microversion: 2.1 time: 0.151962 Jul 27 09:09:58.382137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 280/549] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:58 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:58.713399 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-77b56df7-f159-4146-b149-5d200092b779 req-eb02eb19-eaf2-4e53-a6b8-f59473869186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101d8a8d-3f58-4188-9418-feacb85a7388", "name": "network-vif-deleted", "tag": "19e172a6-c423-45b5-8ca8-47b31210aa90"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:09:58.723116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-77b56df7-f159-4146-b149-5d200092b779 req-eb02eb19-eaf2-4e53-a6b8-f59473869186 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.723669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-77b56df7-f159-4146-b149-5d200092b779 req-eb02eb19-eaf2-4e53-a6b8-f59473869186 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.735604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-77b56df7-f159-4146-b149-5d200092b779 req-eb02eb19-eaf2-4e53-a6b8-f59473869186 service nova] Creating event network-vif-deleted:19e172a6-c423-45b5-8ca8-47b31210aa90 for instance 101d8a8d-3f58-4188-9418-feacb85a7388 on hv-cinder-79760 Jul 27 09:09:58.740447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-77b56df7-f159-4146-b149-5d200092b779 req-eb02eb19-eaf2-4e53-a6b8-f59473869186 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031064 Jul 27 09:09:58.741045 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 270/550] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:09:58.985071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:58.985687 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:58.991810 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.992265 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:58.993238 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:58.993676 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:59.057094 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:59.065018 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7fff8568-8de2-4029-ac3e-a10f92fbcdb7 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 200 len: 1623 microversion: 2.1 time: 0.083718 Jul 27 09:09:59.065658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 281/551] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:58 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 1623 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:09:59.405454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:09:59.406184 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:09:59.413227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:59.413858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:59.414615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:09:59.415051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:09:59.559546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:09:59.568309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0944df2f-90ee-40c1-8af4-bfbcbdfc7769 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1682 microversion: 2.1 time: 0.167051 Jul 27 09:09:59.568886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 271/552] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:09:59 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:00.138186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:00.138790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 101d8a8d-3f58-4188-9418-feacb85a7388] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:00.145535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:00.145988 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:00.146764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:00.147239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:00.162654 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] HTTP exception thrown: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Request method failure captured: Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 HTTP/1.1 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-7-iJrST1KTh6rFdPReTUtzFOhnJwCqmKmOQ7sjK_SuSrQR6GVqwr2dWXE9kuH7mF3IezmYxX3c8B3q5wGtEib6CE4Dm7DBLIcG6uj4-qq87DlLaa4rM7nHrSKLxh52r_DnQECbWeH3PvguFBSR_cuOwnh_ATMexGSbDnN-9taDo8 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:10:00.164169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91b6498ed874b4cac422867319642bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91b6498ed874b4cac422867319642bb"}]}] Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c0b38d0f4f5a4127bc908e07a6629342 Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. Jul 27 09:10:00.165755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '101d8a8d-3f58-4188-9418-feacb85a7388'} Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:10:00.166568 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. Jul 27 09:10:00.168051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:00.169885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Returning 404 to user: Instance 101d8a8d-3f58-4188-9418-feacb85a7388 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:10:00.169885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-79839e10-8989-42ff-9d06-4307e73f47bf tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388" status: 404 len: 111 microversion: 2.1 time: 0.083441 Jul 27 09:10:00.169885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 282/553] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:00 2022] GET /compute/v2.1/servers/101d8a8d-3f58-4188-9418-feacb85a7388 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:10:00.174331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-82947d0c-d483-4514-bacd-ff60810c4d1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '.version_select at 0x7f6f94631d30>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:00.194108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-82947d0c-d483-4514-bacd-ff60810c4d1b tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004193292" status: 202 len: 0 microversion: 2.1 time: 0.023472 Jul 27 09:10:00.194835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 272/554] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004193292 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:10:00.598408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:00.600306 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:00.607311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:00.608105 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:00.609019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:00.609563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:00.811443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:00.820327 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-aea68b57-3a47-4bef-9a95-84c30f515901 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 200 len: 1682 microversion: 2.1 time: 0.234213 Jul 27 09:10:00.820913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 283/555] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:00 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:01.083316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-ee125cd7-3e9a-40a4-9d60-9527ff40584c req-61de2a3f-e4d9-4056-8f43-8272f213b558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df65d0e3-a3cb-4a90-85fa-257d141ea072", "name": "network-vif-deleted", "tag": "af900191-366c-4d92-85de-51351e1d44cd"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:01.095016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-ee125cd7-3e9a-40a4-9d60-9527ff40584c req-61de2a3f-e4d9-4056-8f43-8272f213b558 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:01.095452 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-ee125cd7-3e9a-40a4-9d60-9527ff40584c req-61de2a3f-e4d9-4056-8f43-8272f213b558 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:01.109579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-ee125cd7-3e9a-40a4-9d60-9527ff40584c req-61de2a3f-e4d9-4056-8f43-8272f213b558 service nova] Creating event network-vif-deleted:af900191-366c-4d92-85de-51351e1d44cd for instance df65d0e3-a3cb-4a90-85fa-257d141ea072 on hv-cinder-79760 Jul 27 09:10:01.115707 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-ee125cd7-3e9a-40a4-9d60-9527ff40584c req-61de2a3f-e4d9-4056-8f43-8272f213b558 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Jul 27 09:10:01.117046 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 273/556] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:01.844277 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:01.845275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:01.856063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:01.857103 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:01.858415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:01.858963 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:01.866946 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:01.885036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 HTTP/1.1 Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:10:01.886690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:10:01.888337 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'df65d0e3-a3cb-4a90-85fa-257d141ea072'} Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:10:01.889124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:10:01.890415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:01.892037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:10:01.892037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-858c2fea-d843-42d2-b659-94a49f559f7a tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 404 len: 111 microversion: 2.1 time: 0.049568 Jul 27 09:10:01.892037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 284/557] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:01 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:10:01.898385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7034013f-e061-4fab-b53c-d92ee73f2ed0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '.version_select at 0x7f6f945275e0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:01.920149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7034013f-e061-4fab-b53c-d92ee73f2ed0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006816700" status: 202 len: 0 microversion: 2.1 time: 0.026246 Jul 27 09:10:01.920787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 274/558] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006816700 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:10:02.588556 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6ddc14b0-0c9d-44c5-92fb-32f0b0e3a621 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: .version_select at 0x7f6f87db3820>, body: {"keypair": {"name": "tempest-keypair-2001286241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPqQyIyMlo2ptb0y0BHAr++mryJQdcMJ4zDnuGGK+yyTdWoec5Yo2yamJuJtyUtZEvejsMCDG0c8dkrER3nngX8ZcosiA3FCghxM2umilaUYXHhxvxHW8DrfqLsZnkjdA=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:02.606323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-6ddc14b0-0c9d-44c5-92fb-32f0b0e3a621 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:10:02.610203 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-6ddc14b0-0c9d-44c5-92fb-32f0b0e3a621 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:10:02.632517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6ddc14b0-0c9d-44c5-92fb-32f0b0e3a621 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047912 Jul 27 09:10:02.633091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 285/559] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:10:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:03.233404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:03.234150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:03.241409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:03.242006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:03.242838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:03.243606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:03.270547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:10:03.285811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:03.353013 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-72820a85-328d-47c7-b4ad-72f889cf4150 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 204 len: 0 microversion: 2.1 time: 0.123701 Jul 27 09:10:03.354055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 275/560] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:10:03 2022] DELETE /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:10:03.363307 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:03.363996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:03.373218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:03.373664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:03.374439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:03.374873 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:03.512388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:03.520765 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c8884b10-04fc-41f3-b858-f7636d1bef27 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1507 microversion: 2.1 time: 0.162354 Jul 27 09:10:03.521383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 286/561] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:03 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:03.899469 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1522906341", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "effe6ca8-c538-478b-abc9-f3d649387e81"}], "security_groups": [{"name": "tempest-securitygroup--2134428505"}], "key_name": "tempest-keypair-2001286241", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:04.009381 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] validate_networks() for [('effe6ca8-c538-478b-abc9-f3d649387e81', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:10:04.481122 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:10:04.481683 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:10:04.482018 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:10:04.482428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:10:04.482842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:10:04.491874 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.492323 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.493129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.493565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.511255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:10:04.515238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Getting quotas for user 7e4aa5d828d24af79648ca68b3ec84c9 and project fe9b1bb674c843839c9622a722c793ab. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:10:04.526643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:10:04.529006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:10:04.542444 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:04.543683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:04.552026 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.552519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.553390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.553822 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.576835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f8a1727c-d3eb-4e9b-abaf-cbc2228a3b69 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682003 Jul 27 09:10:04.583320 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 276/562] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:10:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:10:04.588645 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1f38fd8d-a9c4-4e08-8070-fe27f8b76333 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:04.589291 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1f38fd8d-a9c4-4e08-8070-fe27f8b76333 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:04.648739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1f38fd8d-a9c4-4e08-8070-fe27f8b76333 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:04.657389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1f38fd8d-a9c4-4e08-8070-fe27f8b76333 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1242 microversion: 2.1 time: 0.072432 Jul 27 09:10:04.658064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 277/563] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:04 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:04.717898 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:04.725502 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-15e9e5f1-9710-43b3-ae2d-c48b2d3db59e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1507 microversion: 2.1 time: 0.186859 Jul 27 09:10:04.726082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 287/564] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:04 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:04.915713 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:04.916230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:04.922923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.923363 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.924908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:04.925338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:04.949515 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1a718edd-c4b6-4ce0-8aa4-910a2d77fce6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/ips" status: 200 len: 152 microversion: 2.20 time: 0.098280 Jul 27 09:10:04.950084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 278/565] 10.222.0.33 () {60 vars in 1289 bytes} [Wed Jul 27 09:10:04 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/ips => generated 152 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:10:05.679183 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:05.679848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:05.686353 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:05.686803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:05.687581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:05.688042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:05.747950 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:05.748909 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:05.754166 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:05.760616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:05.760941 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:05.761746 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:05.762191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:05.765441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-35e62adb-9f4d-46f0-8d3a-071d0ed315bf tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1294 microversion: 2.1 time: 0.090044 Jul 27 09:10:05.775831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 288/566] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:05 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:06.024200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:06.034492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-07d5f22f-3eeb-4f12-98cb-41a4f98aadfb tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 200 len: 1507 microversion: 2.1 time: 0.291958 Jul 27 09:10:06.044069 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 279/567] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:05 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:06.292999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-84a8b6b6-8ad5-4b14-84e4-6ea21f659c41 req-2947dc96-9e0a-409f-884f-181ced866367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7153fbcc-b11f-4390-abff-969685efd1e5", "name": "network-vif-deleted", "tag": "98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:06.319792 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-84a8b6b6-8ad5-4b14-84e4-6ea21f659c41 req-2947dc96-9e0a-409f-884f-181ced866367 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:06.321591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-84a8b6b6-8ad5-4b14-84e4-6ea21f659c41 req-2947dc96-9e0a-409f-884f-181ced866367 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:06.340048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-84a8b6b6-8ad5-4b14-84e4-6ea21f659c41 req-2947dc96-9e0a-409f-884f-181ced866367 service nova] Creating event network-vif-deleted:98d34bd7-ddcb-42ef-969d-8a7a6fcfc9c8 for instance 7153fbcc-b11f-4390-abff-969685efd1e5 on hv-cinder-79760 Jul 27 09:10:06.348720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-84a8b6b6-8ad5-4b14-84e4-6ea21f659c41 req-2947dc96-9e0a-409f-884f-181ced866367 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060504 Jul 27 09:10:06.349996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 289/568] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:06.791663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:06.792848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:06.802584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:06.803341 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:06.804309 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:06.805091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:06.957181 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:06.964609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d0306162-cb46-4cad-bf29-9b50315fd498 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.181095 Jul 27 09:10:06.965185 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 280/569] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:06 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:07.056818 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:07.057638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 7153fbcc-b11f-4390-abff-969685efd1e5] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.065210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.065857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.066763 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.067197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.080488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] HTTP exception thrown: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Request method failure captured: Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 HTTP/1.1 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-7-iJrST1KTh6rFdPReTUtzFOhnJwCqmKmOQ7sjK_SuSrQR6GVqwr2dWXE9kuH7mF3IezmYxX3c8B3q5wGtEib6CE4Dm7DBLIcG6uj4-qq87DlLaa4rM7nHrSKLxh52r_DnQECbWeH3PvguFBSR_cuOwnh_ATMexGSbDnN-9taDo8 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:10:07.082106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91b6498ed874b4cac422867319642bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91b6498ed874b4cac422867319642bb"}]}] Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c0b38d0f4f5a4127bc908e07a6629342 Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. Jul 27 09:10:07.083625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '7153fbcc-b11f-4390-abff-969685efd1e5'} Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:10:07.084457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. Jul 27 09:10:07.085819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:07.087193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Returning 404 to user: Instance 7153fbcc-b11f-4390-abff-969685efd1e5 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:10:07.087193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7e79e885-2f33-4a9e-b01e-24fa1936ef8a tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5" status: 404 len: 111 microversion: 2.1 time: 0.030909 Jul 27 09:10:07.087193 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 290/570] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:07 2022] GET /compute/v2.1/servers/7153fbcc-b11f-4390-abff-969685efd1e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:10:07.092028 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:07.092521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.099065 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.099505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.100338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.100782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.125930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:10:07.203701 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e7b34faf-7384-4d07-bae7-2eea2611e333 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 204 len: 0 microversion: 2.1 time: 0.115084 Jul 27 09:10:07.207966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 281/571] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:10:07 2022] DELETE /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:10:07.213090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:07.213737 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.220070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.220518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.221326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.221769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.356481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:07.357092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.363783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.364322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.365095 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.365526 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.389788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lazy-loading 'flavor' on Instance uuid a3f4311a-0b1e-4564-9584-6b6632e59473 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:10:07.483557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:07.493076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-86df7867-077f-4426-a762-243f7b20d02d tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.283812 Jul 27 09:10:07.506883 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 291/572] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:07 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:07.591278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-13193b42-a1bd-4a2a-b42a-e73d2305d850 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/action" status: 202 len: 0 microversion: 2.20 time: 0.239032 Jul 27 09:10:07.591940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 282/573] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Jul 27 09:10:07 2022] POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 09:10:07.601586 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:07.602357 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.609184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.609637 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.610417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.610859 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.673588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-da6fb35c-55bb-417f-bb20-89709a53ff84 req-150af03c-7ae1-4a60-98d4-93299a7f238d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1157b873-b02a-425b-8226-1e8e570a104b", "tag": "fcdb4479-7897-4b3b-80de-a1f2b252675d"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:07.684719 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-da6fb35c-55bb-417f-bb20-89709a53ff84 req-150af03c-7ae1-4a60-98d4-93299a7f238d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.685317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-da6fb35c-55bb-417f-bb20-89709a53ff84 req-150af03c-7ae1-4a60-98d4-93299a7f238d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.698936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-da6fb35c-55bb-417f-bb20-89709a53ff84 req-150af03c-7ae1-4a60-98d4-93299a7f238d service nova] Creating event network-changed:fcdb4479-7897-4b3b-80de-a1f2b252675d for instance 1157b873-b02a-425b-8226-1e8e570a104b on hv-cinder-79760 Jul 27 09:10:07.704755 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-da6fb35c-55bb-417f-bb20-89709a53ff84 req-150af03c-7ae1-4a60-98d4-93299a7f238d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Jul 27 09:10:07.706043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 283/574] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:10:07.793016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:07.801358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:07.802806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:07.803998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f620926a-e8c0-4e28-b9f2-ddeb34c7a55a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.207442 Jul 27 09:10:07.804575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 292/575] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:07 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:07.987511 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:07.988226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:07.995285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.995740 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:07.996537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:07.996977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:08.125838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:08.133311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-32a2ef5d-e616-4b07-a39a-4d4ff9e06257 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.150524 Jul 27 09:10:08.134158 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 284/576] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:07 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:08.514767 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:08.515375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:08.522031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:08.522474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:08.523242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:08.523675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:08.659316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:08.667252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b4381100-a8c2-4b2f-8d32-1496c794e544 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.156401 Jul 27 09:10:08.667849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 293/577] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:08 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:08.828796 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:08.829316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:08.835899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:08.836340 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:08.837095 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:08.837521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:08.963663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:08.972316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:08.973841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:08.975003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f96043a5-73b5-40be-81c8-c1ea07564d9c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.150172 Jul 27 09:10:08.975578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 285/578] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:08 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:09.154417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:09.155034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:09.161229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:09.161673 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:09.162499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:09.162878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:09.293892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:09.301858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-33ca07c5-2b8d-4698-b58b-cd4e0f734812 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.151286 Jul 27 09:10:09.302422 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 294/579] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:09 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:09.690350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:09.690958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:09.697927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:09.698374 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:09.699145 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:09.699584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:09.835232 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:09.842942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-147a7a9d-ea00-49ab-8667-24ae7a85237e tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1523 microversion: 2.1 time: 0.156464 Jul 27 09:10:09.843516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 286/580] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:09 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:09.998061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:09.998650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:10.005026 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.005476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.006246 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.006683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.178796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:10.186629 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:10.188134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:10.189286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b4b5c15e-aba4-4b32-b491-39674b6abc53 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.195427 Jul 27 09:10:10.189890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 295/581] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:09 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:10.324226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:10.324756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:10.331332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.332012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.332801 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.333233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.578891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:10.608744 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f5694218-c0e5-4891-b75a-744959a461c9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.288884 Jul 27 09:10:10.610513 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 287/582] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:10 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:10.866664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:10.867310 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:10.881419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-f1a29103-eb0e-4cb0-a49d-ee2c7b3cb560 req-aa98c3a0-0f85-408f-aae2-a10d4edaf22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583fd69f-8c45-4b97-b0af-1f5d703612e6", "name": "network-vif-deleted", "tag": "93857c74-06f2-4e64-951c-128509b48787"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:10.888694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:10.890303 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.890977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.892240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.892708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.899127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f1a29103-eb0e-4cb0-a49d-ee2c7b3cb560 req-aa98c3a0-0f85-408f-aae2-a10d4edaf22b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:10.899739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f1a29103-eb0e-4cb0-a49d-ee2c7b3cb560 req-aa98c3a0-0f85-408f-aae2-a10d4edaf22b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:10.916584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-f1a29103-eb0e-4cb0-a49d-ee2c7b3cb560 req-aa98c3a0-0f85-408f-aae2-a10d4edaf22b service nova] Creating event network-vif-deleted:93857c74-06f2-4e64-951c-128509b48787 for instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 on hv-cinder-79760 Jul 27 09:10:10.922312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-f1a29103-eb0e-4cb0-a49d-ee2c7b3cb560 req-aa98c3a0-0f85-408f-aae2-a10d4edaf22b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044419 Jul 27 09:10:10.923016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 288/583] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:10.977119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:10.984683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f9410a7d-c9b6-4b52-80e7-410ddd53b87f tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1481 microversion: 2.1 time: 0.124154 Jul 27 09:10:10.985253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 296/584] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:10 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1481 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:11.213224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:11.213930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:11.221593 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:11.222036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:11.222819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:11.223262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:11.358126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:11.366618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:11.368138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:11.369279 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-558f4857-a0c6-4808-b473-0fe323475cfb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.160541 Jul 27 09:10:11.370332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 289/585] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:11 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:11.630495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:11.631236 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:11.638118 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:11.638560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:11.639353 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:11.639822 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:11.780234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:11.788575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bc74d11d-0f2c-43b3-8976-dd1cd256b60d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.161925 Jul 27 09:10:11.789253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 297/586] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:11 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:12.006307 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:12.007623 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:12.015318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.016257 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.017147 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.017673 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.053960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.054771 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.055477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lazy-loading 'fault' on Instance uuid 583fd69f-8c45-4b97-b0af-1f5d703612e6 {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:10:12.058628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:12.107562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b38d0f4f5a4127bc908e07a6629342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91b6498ed874b4cac422867319642bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:12.115193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8a226091-3c46-4738-841b-3a57b9d6fd92 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 200 len: 1312 microversion: 2.1 time: 0.114001 Jul 27 09:10:12.115778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 290/587] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:12 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:12.394553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:12.395157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:12.401646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.402085 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.402849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.403279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.535400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:12.543249 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:12.544790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:12.545957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-62413133-0ce0-45b7-a400-503901b42db0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.156024 Jul 27 09:10:12.546520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 298/588] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:12 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:12.810758 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:12.811277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:12.818043 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.818482 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.819233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:12.819659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:12.951282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:12.958590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b18c6661-ecbd-437e-a6a1-fd7596a9bab0 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.151946 Jul 27 09:10:12.959158 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 291/589] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:12 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:13.136633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:13.137242 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] [instance: 583fd69f-8c45-4b97-b0af-1f5d703612e6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:13.139294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:13.145222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.145663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.146432 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.146861 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.161040 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] HTTP exception thrown: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Request method failure captured: Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 HTTP/1.1 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-7-iJrST1KTh6rFdPReTUtzFOhnJwCqmKmOQ7sjK_SuSrQR6GVqwr2dWXE9kuH7mF3IezmYxX3c8B3q5wGtEib6CE4Dm7DBLIcG6uj4-qq87DlLaa4rM7nHrSKLxh52r_DnQECbWeH3PvguFBSR_cuOwnh_ATMexGSbDnN-9taDo8 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:10:13.162574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f91b6498ed874b4cac422867319642bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f91b6498ed874b4cac422867319642bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f91b6498ed874b4cac422867319642bb"}]}] Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f91b6498ed874b4cac422867319642bb Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-752225481 Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c0b38d0f4f5a4127bc908e07a6629342 Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-752225481-project Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. Jul 27 09:10:13.164216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '583fd69f-8c45-4b97-b0af-1f5d703612e6'} Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:10:13.165386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. Jul 27 09:10:13.166900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:10:13.169165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] Returning 404 to user: Instance 583fd69f-8c45-4b97-b0af-1f5d703612e6 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:10:13.169165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0b465a9f-c3a8-46f4-b48e-668f0c54fe95 tempest-ServerRescueNegativeTestJSON-752225481 tempest-ServerRescueNegativeTestJSON-752225481-project] 10.222.0.33 "GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6" status: 404 len: 111 microversion: 2.1 time: 0.031501 Jul 27 09:10:13.169165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 299/590] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:13 2022] GET /compute/v2.1/servers/583fd69f-8c45-4b97-b0af-1f5d703612e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:10:13.569616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:13.570306 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:13.576591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.577066 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.577851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.578284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.709781 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:13.717792 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:13.719398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:13.720732 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1ebac134-e7db-4cbb-beef-05b094ab6a4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.155182 Jul 27 09:10:13.721378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 292/591] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:13 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:13.971726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-911a2714-5520-4bec-bbd7-46dd3e1cd5f2 req-ec57cd1b-6147-42e9-8ccf-ff53725752bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1157b873-b02a-425b-8226-1e8e570a104b", "name": "network-vif-plugged", "status": "completed", "tag": "fcdb4479-7897-4b3b-80de-a1f2b252675d"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:13.979132 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:13.979897 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:13.986228 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.986681 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.988093 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:13.988533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:13.999564 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-911a2714-5520-4bec-bbd7-46dd3e1cd5f2 req-ec57cd1b-6147-42e9-8ccf-ff53725752bc service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:14.000041 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-911a2714-5520-4bec-bbd7-46dd3e1cd5f2 req-ec57cd1b-6147-42e9-8ccf-ff53725752bc service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:14.013884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-911a2714-5520-4bec-bbd7-46dd3e1cd5f2 req-ec57cd1b-6147-42e9-8ccf-ff53725752bc service nova] Creating event network-vif-plugged:fcdb4479-7897-4b3b-80de-a1f2b252675d for instance 1157b873-b02a-425b-8226-1e8e570a104b on hv-cinder-79760 Jul 27 09:10:14.020032 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-911a2714-5520-4bec-bbd7-46dd3e1cd5f2 req-ec57cd1b-6147-42e9-8ccf-ff53725752bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053042 Jul 27 09:10:14.021339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 300/592] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:14.168655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:14.178322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-239da152-61a7-4a34-98dd-b6af93a4c192 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.202625 Jul 27 09:10:14.178924 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 293/593] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:13 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:14.744318 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:14.745035 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:14.752434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:14.752893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:14.753744 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:14.754464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:15.199581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:15.200718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:15.203952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:15.204969 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=8 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:15.210400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:15.211127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:15.212070 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:15.212637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:15.251131 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:15.263605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:15.266165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:15.267560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-89779b7a-5203-4dd5-86e6-f61beed630a6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.528414 Jul 27 09:10:15.268338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 301/594] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:14 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:15.354473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:15.363926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8e102a31-4a8f-4c8f-b034-8a009fd6d188 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1368 microversion: 2.1 time: 0.168409 Jul 27 09:10:15.364715 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 294/595] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:15 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:16.291384 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:16.292115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:16.298543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.299630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.300616 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.301089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.385990 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:16.386605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:16.393389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.394328 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.395107 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.395543 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.437032 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:16.446174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:16.447925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:16.449467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a47254d6-4bed-45f6-9a0c-2811dd7a1917 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.161983 Jul 27 09:10:16.450153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 302/596] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:16 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:16.683045 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:16.691692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f255c108-7dc9-4c8b-8ab2-34def538acc6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1559 microversion: 2.1 time: 0.309531 Jul 27 09:10:16.692607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 295/597] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:16 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1559 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:10:16.713990 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:16.714483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:16.716467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:16.732895 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.733271 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.734041 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:16.734476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:16.825543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7878a09e-e14b-48b7-ac48-91b127bc9779 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115499 Jul 27 09:10:16.826221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 303/598] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:10:16 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:17.474058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:17.474798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:17.481434 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:17.482001 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:17.482883 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:17.483384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:17.742904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:17.756189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:17.757902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:17.759579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c989c05b-fdef-48af-a0eb-04f55dbf4566 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.290612 Jul 27 09:10:17.760762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 296/599] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:17 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:18.170129 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-562014b7-f460-4f41-986b-eba5805a0c4c req-683b43f9-0aa2-468e-aace-a2d8f2ee454d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1157b873-b02a-425b-8226-1e8e570a104b", "tag": "fcdb4479-7897-4b3b-80de-a1f2b252675d"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:18.182601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-562014b7-f460-4f41-986b-eba5805a0c4c req-683b43f9-0aa2-468e-aace-a2d8f2ee454d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:18.183127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-562014b7-f460-4f41-986b-eba5805a0c4c req-683b43f9-0aa2-468e-aace-a2d8f2ee454d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:18.194845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-562014b7-f460-4f41-986b-eba5805a0c4c req-683b43f9-0aa2-468e-aace-a2d8f2ee454d service nova] Creating event network-changed:fcdb4479-7897-4b3b-80de-a1f2b252675d for instance 1157b873-b02a-425b-8226-1e8e570a104b on hv-cinder-79760 Jul 27 09:10:18.200826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-562014b7-f460-4f41-986b-eba5805a0c4c req-683b43f9-0aa2-468e-aace-a2d8f2ee454d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035108 Jul 27 09:10:18.201755 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 304/600] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:18.783804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:18.784440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:18.793440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:18.794113 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:18.795067 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:18.795505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:18.945693 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:18.958274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:18.959830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:18.961021 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0c391671-6b8b-406c-8e22-bd23ac039832 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.181538 Jul 27 09:10:18.972476 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 297/601] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:18 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:19.987294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:19.988065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:19.996928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:19.997489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:19.998349 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:19.999049 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:20.151411 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:20.169033 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:20.170623 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:20.171980 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1561154a-3200-40d9-9506-6d247c7f06ba tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.189959 Jul 27 09:10:20.172929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 305/602] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:19 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:21.198077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:21.198853 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:21.206767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:21.208010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:21.208985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:21.209427 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:21.352247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:21.361304 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:21.363092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:21.364428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a1c66235-9fbc-4d36-9297-5da6192bc7ca tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.171833 Jul 27 09:10:21.365126 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 298/603] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:21 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:22.394222 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:22.395038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:22.407048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:22.407595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:22.409232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:22.409878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:22.438185 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=100 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:22.585647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:22.593908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:22.595927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:22.597343 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4c210916-0b63-4b9b-98ee-e686ed53f7ad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.210736 Jul 27 09:10:22.598695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 306/604] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:22 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:22.805561 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3c295418-0970-437d-af48-e759d197fba9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: .version_select at 0x7f6f94520310>, body: {"keypair": {"name": "tempest-keypair-904088583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIZq0DHT5TPmY3jBSkj3rL2H2iOxnB5IMfPhr+lAZLgISTll63JBcGwPdy3D2N4O9KR26PH9gGjjteemm1NazwiyKWjerG2bphFEYm9arj6TIiqfcJxJ54O2L+8M/byDw=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:22.821850 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-3c295418-0970-437d-af48-e759d197fba9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:10:22.826049 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-3c295418-0970-437d-af48-e759d197fba9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for user c1512e7653d140d9a14d3981a8215969 and project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:10:22.849773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3c295418-0970-437d-af48-e759d197fba9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170351 Jul 27 09:10:22.850579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 299/605] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:10:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:23.621668 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:23.622272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:23.629380 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:23.629824 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:23.630756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:23.631368 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:23.866856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:23.876070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:23.877856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:23.879232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6e9f1fb8-c204-4689-b3ac-363b14f56166 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.261980 Jul 27 09:10:23.879826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 307/606] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:23 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:24.525178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-164209254", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c63381ac-c660-4a56-bcaf-3c3c72451253"}], "security_groups": [{"name": "tempest-securitygroup--38723781"}], "key_name": "tempest-keypair-904088583", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:24.629905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] validate_networks() for [('c63381ac-c660-4a56-bcaf-3c3c72451253', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:10:24.905466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:24.906091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:24.914850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:24.915643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:24.916676 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:24.917127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:25.072764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:25.081115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:25.082614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:25.083817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7164c2fe-4c0a-4e3f-be6a-245b6dba292e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.182798 Jul 27 09:10:25.084711 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 308/607] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:24 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:25.282509 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:10:25.283468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:10:25.283970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:10:25.284381 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:10:25.284794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:10:25.293959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:25.294402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:25.295196 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:25.295622 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:25.312990 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:10:25.319605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for user c1512e7653d140d9a14d3981a8215969 and project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:10:25.333169 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:10:25.335634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:10:25.384689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-72e1a922-fb11-4d75-89e0-6dd022616058 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.864209 Jul 27 09:10:25.385763 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 300/608] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:10:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:10:25.397212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3677360c-004d-4387-8d7e-0b377c5eb25d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:25.398235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3677360c-004d-4387-8d7e-0b377c5eb25d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:25.455506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3677360c-004d-4387-8d7e-0b377c5eb25d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:25.463120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3677360c-004d-4387-8d7e-0b377c5eb25d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1236 microversion: 2.1 time: 0.069831 Jul 27 09:10:25.463918 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 309/609] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:25 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:26.107193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:26.108061 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:26.123694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:26.124230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:26.124942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:26.125378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:26.275658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:26.283997 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:26.285792 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:26.287058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-96baf73b-e9ca-4300-bcc0-1498ebabe290 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1745 microversion: 2.20 time: 0.184180 Jul 27 09:10:26.287826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 301/610] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:26 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:26.485957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:26.486661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:26.494877 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:26.495327 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:26.520641 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:26.521063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:26.598844 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:26.619239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2c644ed6-05ec-4adb-8982-b1af601d8089 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1288 microversion: 2.1 time: 0.138108 Jul 27 09:10:26.620378 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 310/611] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:26 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:27.310905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:27.311488 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:27.319576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:27.320057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:27.320858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:27.321331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:27.487230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:27.495744 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:27.497581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:27.498999 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0911a4ce-725a-4cb8-95f3-6f2bb3753947 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1745 microversion: 2.20 time: 0.192262 Jul 27 09:10:27.499827 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 302/612] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:27 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:27.646799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:27.649672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:27.661764 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:27.662224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:27.663042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:27.663484 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:27.939539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:27.956687 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2986d18d-13a0-470f-8caa-44cf757d2e87 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.318997 Jul 27 09:10:27.959840 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 311/613] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:27 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:28.175350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-c1527236-5eaa-481d-a03a-f23950d7db67 req-307edcb3-2199-403d-b9cf-4e1f1ce6dfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "name": "network-vif-plugged", "status": "completed", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:28.190060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-c1527236-5eaa-481d-a03a-f23950d7db67 req-307edcb3-2199-403d-b9cf-4e1f1ce6dfd8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.190557 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-c1527236-5eaa-481d-a03a-f23950d7db67 req-307edcb3-2199-403d-b9cf-4e1f1ce6dfd8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:28.202356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-c1527236-5eaa-481d-a03a-f23950d7db67 req-307edcb3-2199-403d-b9cf-4e1f1ce6dfd8 service nova] Creating event network-vif-plugged:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:10:28.243263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-c1527236-5eaa-481d-a03a-f23950d7db67 req-307edcb3-2199-403d-b9cf-4e1f1ce6dfd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064775 Jul 27 09:10:28.245680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 303/614] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:28.524631 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:28.525406 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:28.530257 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-13bfe307-ccad-49ec-b438-7cd5c6ab4c55 req-452d7780-e1c4-4526-9fa3-1aec4ba79312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19c9de0-10fe-40cd-a028-73ab5644fc56", "tag": "32b599c1-00f0-467f-b4d8-741ad2979692"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:28.540401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.540846 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:28.541637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.542063 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:28.544914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-13bfe307-ccad-49ec-b438-7cd5c6ab4c55 req-452d7780-e1c4-4526-9fa3-1aec4ba79312 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.545622 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-13bfe307-ccad-49ec-b438-7cd5c6ab4c55 req-452d7780-e1c4-4526-9fa3-1aec4ba79312 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:28.567936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-13bfe307-ccad-49ec-b438-7cd5c6ab4c55 req-452d7780-e1c4-4526-9fa3-1aec4ba79312 service nova] Creating event network-changed:32b599c1-00f0-467f-b4d8-741ad2979692 for instance d19c9de0-10fe-40cd-a028-73ab5644fc56 on hv-cinder-79760 Jul 27 09:10:28.573843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-13bfe307-ccad-49ec-b438-7cd5c6ab4c55 req-452d7780-e1c4-4526-9fa3-1aec4ba79312 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150430 Jul 27 09:10:28.575013 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 312/615] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:28.737417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:28.749098 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:28.753609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:28.754953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-15f5039b-2b73-4999-9d1e-f8c74b5dd147 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.234943 Jul 27 09:10:28.755409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 304/616] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:28 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:10:28.983515 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:28.984261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:28.994983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.995434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:28.996254 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:28.996692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:29.168675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:29.179107 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-960d11da-fca3-41ab-bb31-5115d2e09147 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.200252 Jul 27 09:10:29.180596 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 313/617] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:28 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:29.781389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:29.782209 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:29.789778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:29.790367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:29.791849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:29.792525 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:29.964182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:29.976787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:29.978610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:29.982801 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-637a3569-e7a6-47e5-b2a3-d5dcd6868c1b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.206475 Jul 27 09:10:29.983604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 305/618] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:29 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:30.202705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:30.204045 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:30.215611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:30.216451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:30.218803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:30.219630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:30.435624 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:30.445453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2cce246c-fad3-409d-9c93-26ec2bac3ef7 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.246528 Jul 27 09:10:30.464833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 314/619] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:30 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:31.006804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:31.007589 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:31.014778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:31.015227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:31.016051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:31.016490 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:31.188497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:31.199681 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:31.201236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:31.202708 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-120c938d-3293-4b31-a7d5-3acafd4c279e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.199971 Jul 27 09:10:31.204591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 306/620] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:31 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:31.468228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:31.468841 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:31.477576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:31.478265 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:31.479253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:31.479915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:31.628039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:31.639351 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-59d7a703-c2ee-4f90-afa7-e4d1aa0fed80 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.174938 Jul 27 09:10:31.640319 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 315/621] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:31 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:32.226814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:32.227502 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:32.247704 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:32.248885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:32.250629 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:32.251360 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:32.424501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-1cedc4ef-4c27-474f-910b-2466a7d06974 req-44c58756-ee41-4599-8e09-275dc0383739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19c9de0-10fe-40cd-a028-73ab5644fc56", "name": "network-vif-plugged", "status": "completed", "tag": "32b599c1-00f0-467f-b4d8-741ad2979692"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:32.452802 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-1cedc4ef-4c27-474f-910b-2466a7d06974 req-44c58756-ee41-4599-8e09-275dc0383739 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:32.453197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-1cedc4ef-4c27-474f-910b-2466a7d06974 req-44c58756-ee41-4599-8e09-275dc0383739 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:32.469270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-1cedc4ef-4c27-474f-910b-2466a7d06974 req-44c58756-ee41-4599-8e09-275dc0383739 service nova] Creating event network-vif-plugged:32b599c1-00f0-467f-b4d8-741ad2979692 for instance d19c9de0-10fe-40cd-a028-73ab5644fc56 on hv-cinder-79760 Jul 27 09:10:32.474771 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-1cedc4ef-4c27-474f-910b-2466a7d06974 req-44c58756-ee41-4599-8e09-275dc0383739 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159800 Jul 27 09:10:32.475960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 316/622] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:32.492076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:32.506598 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:32.508384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:32.510531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-301c3d10-34cd-4ae1-92f2-74b7cd660f44 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.288250 Jul 27 09:10:32.511202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 307/623] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:32 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:32.662793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:32.663574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:32.671285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:32.679996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:32.681161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:32.681765 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:32.874227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:32.885346 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-914c0bbd-50ef-42b2-9d0f-8c37205f2bed tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.227675 Jul 27 09:10:32.896175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 317/624] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:32 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:33.534996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:33.535630 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:33.543137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:33.543680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:33.544573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:33.545088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:33.716271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:33.722531 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:33.724356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:33.725638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7987f5fd-81de-4ed7-8e29-d337aaf51b04 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.194869 Jul 27 09:10:33.726236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 308/625] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:33 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:33.909574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:33.911073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:33.918408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:33.918851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:33.919617 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:33.920073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:34.072109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:34.080480 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e55fb47b-b624-45bd-916f-488ae66d54da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1360 microversion: 2.1 time: 0.175116 Jul 27 09:10:34.081516 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 318/626] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:33 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:34.750953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:34.752508 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:34.760394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:34.761035 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:34.762025 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:34.762641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:34.784598 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=100 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:34.915856 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:34.930415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:34.932116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:34.933321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-25727035-c4ce-47d4-9d39-74dfe8a5278c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.187035 Jul 27 09:10:34.934165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 309/627] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:34 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:35.103377 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:35.104613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:35.111917 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.112915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:35.114633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.115744 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:35.290263 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:35.302323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9fe4e3ba-6028-47b5-b565-d2c46333bc30 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1546 microversion: 2.1 time: 0.203144 Jul 27 09:10:35.303243 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 319/628] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:10:35 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:10:35.323660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:35.324215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:35.326258 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:35.328481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=10 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:35.336815 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.337340 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:35.338137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.338578 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:35.427092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-501815af-f5e3-4991-a352-4f2676959521 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107148 Jul 27 09:10:35.428038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 310/629] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:10:35 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:35.960021 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:35.960644 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:35.966702 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:35.969111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.970134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:35.971019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:35.971542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:36.230234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:36.244646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:36.246204 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:36.247426 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-87ca8f0b-dda7-494d-95f2-35ce27a4f15b tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.292084 Jul 27 09:10:36.248260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 320/630] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:35 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:36.587189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-266cedc1-6b01-48f0-8f41-7f40373078d0 req-94df9cca-2eda-46d2-b6c6-0445944a6d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19c9de0-10fe-40cd-a028-73ab5644fc56", "tag": "32b599c1-00f0-467f-b4d8-741ad2979692"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:36.597809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-266cedc1-6b01-48f0-8f41-7f40373078d0 req-94df9cca-2eda-46d2-b6c6-0445944a6d1c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:36.598337 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-266cedc1-6b01-48f0-8f41-7f40373078d0 req-94df9cca-2eda-46d2-b6c6-0445944a6d1c service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:36.610450 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-266cedc1-6b01-48f0-8f41-7f40373078d0 req-94df9cca-2eda-46d2-b6c6-0445944a6d1c service nova] Creating event network-changed:32b599c1-00f0-467f-b4d8-741ad2979692 for instance d19c9de0-10fe-40cd-a028-73ab5644fc56 on hv-cinder-79760 Jul 27 09:10:36.620672 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-266cedc1-6b01-48f0-8f41-7f40373078d0 req-94df9cca-2eda-46d2-b6c6-0445944a6d1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037613 Jul 27 09:10:36.621350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 311/631] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:37.273306 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:37.274551 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:37.281611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:37.282381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:37.283367 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:37.285114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:37.540539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:37.548924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:37.550415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:37.553084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6a34a9c6-ddf8-45e7-b10f-6efa343e49c9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1740 microversion: 2.20 time: 0.284796 Jul 27 09:10:37.553822 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 321/632] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:37 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:38.577979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:38.578682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:38.585406 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:38.585841 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:38.586592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:38.587022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:38.726481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:38.734307 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:38.736505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:38.737655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d91cc692-c73b-4e6a-a7d4-a21c454d0b4c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1722 microversion: 2.20 time: 0.164406 Jul 27 09:10:38.738216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 312/633] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:38 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:39.760407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:39.761045 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:39.768099 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:39.768545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:39.769304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:39.769738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:39.898689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:39.906772 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:39.908913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:39.910075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-322c1140-fa88-489a-a4d4-e11aee19ab4e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1722 microversion: 2.20 time: 0.153854 Jul 27 09:10:39.910642 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 322/634] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:39 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:40.933158 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:40.933798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:40.941040 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:40.941486 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:40.942284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:40.942723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.076879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:41.084721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:41.086227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:41.087376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-dae72c19-71bb-4537-9b60-60341104c84f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1665 microversion: 2.20 time: 0.158154 Jul 27 09:10:41.087975 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 313/635] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:40 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:41.109578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f011c8-3788-4ba9-9b5c-93c367e384a5"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:41.112722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:41.120164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.120600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.121364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.121793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.308321 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:41.414759 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a28f534e-dd2f-43da-8da5-596b08bd49f2 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308849 Jul 27 09:10:41.415675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 323/636] 10.222.0.33 () {62 vars in 1364 bytes} [Wed Jul 27 09:10:41 2022] POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 09:10:41.552737 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:41.553230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:41.555158 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:41.560471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.560918 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.561681 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.562110 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.798913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-785df77f-4d03-4d29-9c77-13fb11248368 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments/55f011c8-3788-4ba9-9b5c-93c367e384a5" status: 202 len: 0 microversion: 2.20 time: 0.250051 Jul 27 09:10:41.799512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 314/637] 10.222.0.33 () {60 vars in 1457 bytes} [Wed Jul 27 09:10:41 2022] DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments/55f011c8-3788-4ba9-9b5c-93c367e384a5 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:10:41.859089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:41.859658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:41.865776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.866221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.866983 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.867426 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.945609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4f406f08-ba6f-4ff2-b1e6-9c326bd56c6c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/action" status: 202 len: 0 microversion: 2.20 time: 0.090382 Jul 27 09:10:41.946245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 324/638] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Jul 27 09:10:41 2022] POST /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:10:41.954702 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:41.955461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:41.961980 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.962418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:41.963179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:41.963609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:42.117840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:42.127305 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:42.128837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:42.131163 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cde7498f-60f5-44ef-8395-3c9a37c93cdb tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1673 microversion: 2.20 time: 0.179962 Jul 27 09:10:42.132075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 315/639] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:41 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:42.160495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-26e818a6-8313-4083-80e9-8a841d7d22e8 req-ca8a944e-ff2d-463b-a7d9-d875ef45ed17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "name": "network-vif-unplugged", "status": "completed", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:42.170937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-26e818a6-8313-4083-80e9-8a841d7d22e8 req-ca8a944e-ff2d-463b-a7d9-d875ef45ed17 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:42.171424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-26e818a6-8313-4083-80e9-8a841d7d22e8 req-ca8a944e-ff2d-463b-a7d9-d875ef45ed17 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:42.185061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.compute.server_external_events [req-26e818a6-8313-4083-80e9-8a841d7d22e8 req-ca8a944e-ff2d-463b-a7d9-d875ef45ed17 service nova] Unable to find a host for instance a3f4311a-0b1e-4564-9584-6b6632e59473. Dropping event network-vif-unplugged {{(pid=117923) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 09:10:42.185955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-26e818a6-8313-4083-80e9-8a841d7d22e8 req-ca8a944e-ff2d-463b-a7d9-d875ef45ed17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030594 Jul 27 09:10:42.186830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 325/640] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 09:10:43.154625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:43.155208 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:43.161952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:43.162394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:43.163152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:43.163576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:43.300318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:43.308300 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:43.309802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:43.310956 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a1fc50d8-febe-4b44-bfdd-7cc91defabb1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.160283 Jul 27 09:10:43.311552 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 316/641] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:43 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:44.337920 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:44.339626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:44.355321 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:44.357616 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:44.359349 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:44.360756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:44.536452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:44.544836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:44.546354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:44.548342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-175564f6-bbee-4410-a6be-3c24823ba1a4 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.215722 Jul 27 09:10:44.549386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 326/642] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:44 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:45.572443 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:45.573092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:45.581325 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:45.581857 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:45.582907 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:45.583385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:45.730254 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:45.739595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:45.742276 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:45.744149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-311a5480-9c7a-4a4f-816a-428de37f74ff tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.175732 Jul 27 09:10:45.744787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 317/643] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:45 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:46.769067 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:46.769960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:46.772611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=52 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:46.778441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:46.778916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:46.779713 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:46.780226 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:46.928814 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:46.937319 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:46.939881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:46.941070 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-beb59107-ea0f-4658-98df-22ab6e7dd719 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.176465 Jul 27 09:10:46.941717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 327/644] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:46 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:47.965515 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:47.966554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:47.975866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:47.976588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:47.977381 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:47.977823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:48.117424 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:48.126586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:48.128374 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:48.129636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-60482930-3715-43b6-b4b0-019ddbe2fba1 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.168800 Jul 27 09:10:48.130289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 318/645] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:47 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:49.153799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:49.154437 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:49.161402 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:49.161845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:49.162911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:49.163379 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:49.305272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:49.314051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:49.315756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:49.317005 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a54075ba-094f-44ba-9f4c-fa18b2eeae16 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.167281 Jul 27 09:10:49.317609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 328/646] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:49 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:50.342038 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:50.342653 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:50.349528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:50.349975 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:50.350750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:50.351206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:50.502325 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:50.510773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:50.512303 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:50.513475 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-de411856-0e78-474a-861d-e626ed11e258 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.175578 Jul 27 09:10:50.514247 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 319/647] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:50 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:10:51.537486 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:51.538315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:51.545295 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:51.545777 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:51.546680 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:51.547708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:51.697717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:51.706600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:51.708130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:51.709320 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0b733c62-404a-41cd-90fe-7df1ed927d3a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.176180 Jul 27 09:10:51.722799 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 329/648] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:51 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:52.733675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:52.734285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:52.743353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:52.743994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:52.745071 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:52.745325 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:52.879990 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:52.888485 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:52.889995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:52.891854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b89ce1f1-fc64-4873-a1f1-2f4a6ce96cfc tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.161446 Jul 27 09:10:52.892432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 320/649] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:52 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:53.914796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:53.915488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:53.922861 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:53.923315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:53.924121 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:53.924560 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:54.088390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:54.097143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:54.098655 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:54.099871 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e4e30fbc-6a13-4d9c-8d02-2e082757f122 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.188951 Jul 27 09:10:54.100638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 330/650] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:53 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:55.123156 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:55.123737 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:55.131428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:55.131897 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:55.132862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:55.133637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:55.279854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:55.287799 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:55.289334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:55.290478 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-71a521c5-a5a1-4b7b-90ea-f7eb8358d77f tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.171599 Jul 27 09:10:55.291042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 321/651] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:55 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:10:56.087871 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:56.088508 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:56.095822 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:56.096270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:56.097038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:56.097476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:56.121221 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a000e686-c5bb-4ffb-8d1c-fdb44d528bd6 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/ips" status: 200 len: 151 microversion: 2.1 time: 0.037181 Jul 27 09:10:56.121806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 331/652] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:10:56 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:10:56.314297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:56.315649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:56.323233 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:56.323691 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:56.324750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:56.325239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:56.354239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-fe968da7-9754-49f4-a7c6-3ff0daf3bcbc req-71cd15d7-e487-4073-8eeb-6e489413b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "name": "network-vif-plugged", "status": "completed", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:56.373009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fe968da7-9754-49f4-a7c6-3ff0daf3bcbc req-71cd15d7-e487-4073-8eeb-6e489413b1d7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:56.373648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fe968da7-9754-49f4-a7c6-3ff0daf3bcbc req-71cd15d7-e487-4073-8eeb-6e489413b1d7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:56.388732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-fe968da7-9754-49f4-a7c6-3ff0daf3bcbc req-71cd15d7-e487-4073-8eeb-6e489413b1d7 service nova] Creating event network-vif-plugged:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:10:56.395643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-fe968da7-9754-49f4-a7c6-3ff0daf3bcbc req-71cd15d7-e487-4073-8eeb-6e489413b1d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046711 Jul 27 09:10:56.396468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 332/653] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:10:56.504441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:56.519480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:56.523433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:56.524839 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f1cfeada-8f9b-408b-b790-f3dd61ea8ac9 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.214745 Jul 27 09:10:56.526260 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 322/654] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:56 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:57.545285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee712522-9f1c-4ccf-9301-edbd31d06358"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:10:57.548414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:57.550949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:57.551584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:57.555220 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:57.555630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:57.556424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:57.556869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:57.557934 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:57.558389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:57.559176 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:57.559613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:57.700568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:57.708770 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:57.710273 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:57.711424 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9ddfa3a2-4f5e-451a-a683-48f629396a5a tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.165136 Jul 27 09:10:57.712185 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 323/655] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:57 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:10:57.840796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a5c29a9a-1593-4cbf-81fc-0e41c71eeafa tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "POST /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299589 Jul 27 09:10:57.841415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 333/656] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:10:57 2022] POST /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:10:58.735430 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:58.736102 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:58.743056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:58.743599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:58.744440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:58.744982 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:58.881494 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:58.884008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:58.892762 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:58.894280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:10:58.895445 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-549cfbd6-a526-4e3e-9048-9be4fda8f211 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1731 microversion: 2.20 time: 0.164900 Jul 27 09:10:58.896047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 324/657] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:58 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:10:59.919314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:10:59.920035 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:10:59.926985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:59.927431 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:10:59.928228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:10:59.928669 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:00.061400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:00.069626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:00.071136 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:00.072324 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-de6da3a7-6ed9-4ccd-abd5-f6f900ccefa6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1718 microversion: 2.20 time: 0.157770 Jul 27 09:11:00.072880 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 334/658] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:10:59 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:11:05.460840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:05.461346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:05.469663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:05.470113 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:05.470873 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:05.471312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:05.551649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.objects.instance [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lazy-loading 'services' on Instance uuid 1157b873-b02a-425b-8226-1e8e570a104b {{(pid=117922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:11:05.621684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-362aa44d-2bbf-404d-a0e2-a0218a0974ac tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments/ee712522-9f1c-4ccf-9301-edbd31d06358" status: 202 len: 0 microversion: 2.1 time: 0.164544 Jul 27 09:11:05.622292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 325/659] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:11:05 2022] DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments/ee712522-9f1c-4ccf-9301-edbd31d06358 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:11:05.632183 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:05.634699 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:05.643235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:05.643798 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:05.644706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:05.645157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:05.677638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-dc9b7971-ab92-4853-8601-836490b13c4d tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049764 Jul 27 09:11:05.678364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 335/660] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:11:05 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:11:06.691066 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:06.693479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:06.700245 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.700820 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:06.701576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.702050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:06.736170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5c2d3dc8-5eb7-418d-90de-67dd22f1f0a9 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049999 Jul 27 09:11:06.736745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 326/661] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:11:06 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:11:06.799010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:06.799562 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:06.806015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.806465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:06.807230 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.807666 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:06.832252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:11:06.882034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:06.914746 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-522d7eec-3e58-4963-8cf2-b1aa212550b8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 204 len: 0 microversion: 2.1 time: 0.119184 Jul 27 09:11:06.915830 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 336/662] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:11:06 2022] DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:11:06.925306 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:06.925918 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:06.932135 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.932592 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:06.933344 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:06.933780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:07.064745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:07.072479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4462ecaa-5bb9-4d57-8d04-7f3d7873b6a8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1684 microversion: 2.1 time: 0.151654 Jul 27 09:11:07.073057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 327/663] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:06 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:08.095713 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:08.096439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:08.102939 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:08.103387 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:08.104191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:08.104632 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:08.236829 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:08.244464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eb618297-67d6-4b40-9585-443b93d0c3f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1684 microversion: 2.1 time: 0.153981 Jul 27 09:11:08.245035 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 337/664] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:08 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:09.267516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:09.268269 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:09.275356 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:09.275840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:09.276624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:09.277059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:09.344008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4aa5d828d24af79648ca68b3ec84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b1bb674c843839c9622a722c793ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:09.353564 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5641f1e3-bfac-45c5-bc0c-35adda0465c8 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 200 len: 1616 microversion: 2.1 time: 0.090684 Jul 27 09:11:09.366420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 328/665] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:09 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 1616 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:09.373021 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-b3c5c17c-66fa-4715-9e86-30ce15b30a46 req-09ddb964-c084-48be-af21-388a6e9d5c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1157b873-b02a-425b-8226-1e8e570a104b", "name": "network-vif-deleted", "tag": "fcdb4479-7897-4b3b-80de-a1f2b252675d"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:09.390401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b3c5c17c-66fa-4715-9e86-30ce15b30a46 req-09ddb964-c084-48be-af21-388a6e9d5c36 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:09.391207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-b3c5c17c-66fa-4715-9e86-30ce15b30a46 req-09ddb964-c084-48be-af21-388a6e9d5c36 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:09.407141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-b3c5c17c-66fa-4715-9e86-30ce15b30a46 req-09ddb964-c084-48be-af21-388a6e9d5c36 service nova] Creating event network-vif-deleted:fcdb4479-7897-4b3b-80de-a1f2b252675d for instance 1157b873-b02a-425b-8226-1e8e570a104b on hv-cinder-79760 Jul 27 09:11:09.418512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-b3c5c17c-66fa-4715-9e86-30ce15b30a46 req-09ddb964-c084-48be-af21-388a6e9d5c36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049561 Jul 27 09:11:09.419441 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 338/666] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:11:10.377367 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:10.378077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:10.385019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:10.385466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:10.386246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:10.386680 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:10.400165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b HTTP/1.1 Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:10.401814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:10.403334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '1157b873-b02a-425b-8226-1e8e570a104b'} Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:10.404151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:10.405401 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:10.406471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:10.406471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4e2e2be0-bde8-4b86-a327-86642c50a3b4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 404 len: 111 microversion: 2.1 time: 0.030356 Jul 27 09:11:10.406471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 329/667] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:10 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:10.412951 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-48bebfdf-29b9-4843-9314-9b3dc75f8ab2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '.version_select at 0x7f6f87dfeee0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:10.431869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-48bebfdf-29b9-4843-9314-9b3dc75f8ab2 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001286241" status: 202 len: 0 microversion: 2.1 time: 0.023086 Jul 27 09:11:10.432535 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 339/668] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001286241 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:11:12.193179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:12.193731 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:12.196172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=32 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:12.201530 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.201980 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.203333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.203789 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.219506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b HTTP/1.1 Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:12.221219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.222764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '1157b873-b02a-425b-8226-1e8e570a104b'} Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:12.223612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.225029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.226710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:12.226710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c753a495-5e4e-4a5f-a01d-3b855a5598f4 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 404 len: 111 microversion: 2.1 time: 0.033392 Jul 27 09:11:12.226710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 330/669] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:11:12 2022] DELETE /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:12.231688 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:12.232474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 1157b873-b02a-425b-8226-1e8e570a104b] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:12.239210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.239657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.240438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.240872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.254350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b HTTP/1.1 Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:12.256031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.257753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '1157b873-b02a-425b-8226-1e8e570a104b'} Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:12.258808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. Jul 27 09:11:12.260258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:12.261625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 1157b873-b02a-425b-8226-1e8e570a104b could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:12.261625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-f7a5bcd7-d118-45d2-ae17-ef12a3cfce51 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b" status: 404 len: 111 microversion: 2.1 time: 0.030094 Jul 27 09:11:12.261625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 340/670] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:12 2022] GET /compute/v2.1/servers/1157b873-b02a-425b-8226-1e8e570a104b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:12.897153 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:12.897648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:12.904036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.904486 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.905263 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:12.906311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:12.929005 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-425bada0-19af-4400-a974-065f7164d99a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/ips" status: 200 len: 146 microversion: 2.1 time: 0.035957 Jul 27 09:11:12.929594 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 331/671] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:11:12 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:11:13.399348 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:13.399878 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:13.406451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.406898 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.407665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.408157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.422334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 HTTP/1.1 Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:13.423916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.425433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'df65d0e3-a3cb-4a90-85fa-257d141ea072'} Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:13.426161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.427294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.428493 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:13.428493 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-980710eb-2aca-481f-93f2-a9e39d075113 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 404 len: 111 microversion: 2.1 time: 0.030242 Jul 27 09:11:13.428493 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 341/672] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:11:13 2022] DELETE /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:13.434008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:13.434693 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: df65d0e3-a3cb-4a90-85fa-257d141ea072] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:13.441372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.441818 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.442586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.443088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.457257 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 HTTP/1.1 Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:13.458823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.460448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'df65d0e3-a3cb-4a90-85fa-257d141ea072'} Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:13.461316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. Jul 27 09:11:13.462901 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.464220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance df65d0e3-a3cb-4a90-85fa-257d141ea072 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:13.464220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c6d2e7d1-717d-4485-b62c-2e337a697469 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072" status: 404 len: 111 microversion: 2.1 time: 0.030507 Jul 27 09:11:13.464220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 332/673] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:13 2022] GET /compute/v2.1/servers/df65d0e3-a3cb-4a90-85fa-257d141ea072 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:13.469178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:13.469684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:13.475731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.476214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.477016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.477458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.491127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 HTTP/1.1 Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:13.492692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.494229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '35cc48c5-70ac-463e-98a8-0e4241df0ea6'} Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:13.495123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.496531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.498062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:13.498062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-20a43905-f361-4711-9930-189f506cbb45 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 404 len: 111 microversion: 2.1 time: 0.028741 Jul 27 09:11:13.498062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 342/674] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:11:13 2022] DELETE /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:13.502967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:13.503804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 35cc48c5-70ac-463e-98a8-0e4241df0ea6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:13.510910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.511349 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.512150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:13.512581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:13.527277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 HTTP/1.1 Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:13.529089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.531433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '35cc48c5-70ac-463e-98a8-0e4241df0ea6'} Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:13.532426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. Jul 27 09:11:13.533795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:13.535627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 35cc48c5-70ac-463e-98a8-0e4241df0ea6 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:13.535627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1295052e-9f92-475a-986e-4cc85a71e9ab tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6" status: 404 len: 111 microversion: 2.1 time: 0.031941 Jul 27 09:11:13.535627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 333/675] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:13 2022] GET /compute/v2.1/servers/35cc48c5-70ac-463e-98a8-0e4241df0ea6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:11:14.681610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:14.682107 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:14.689117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:14.689564 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:14.690331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:14.690760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:14.705446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 HTTP/1.1 Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:14.707000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.708647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '0c09eab3-aefe-4c50-b06c-46dfd39da7a6'} Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:14.709542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.711009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.712451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:14.712451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-963c95c0-9dcb-447f-a437-64d7ea127ae7 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 404 len: 111 microversion: 2.1 time: 0.030654 Jul 27 09:11:14.712451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 343/676] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:11:14 2022] DELETE /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:14.717280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:14.717953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] [instance: 0c09eab3-aefe-4c50-b06c-46dfd39da7a6] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:14.724588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:14.725060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:14.725876 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:14.726316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:14.741022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] HTTP exception thrown: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Request method failure captured: Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 HTTP/1.1 Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-47CWyvS09YfSrIf1dIc-z6Mt4j3AdOqy8OCiVNDfjKT9BoOBY8loOpzR1ICLRDJ37XeXttLsKm57BK0oThOfAyJ1CAdd4u7pM8hdN-3ln5NK9PD0Gx0LTKwFtMTa5vSgvKynGPmcbk8upcfVAdVszoe-CTp2oOomDRLi4teRML7I Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:14.742591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe9b1bb674c843839c9622a722c793ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe9b1bb674c843839c9622a722c793ab"}]}] Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: fe9b1bb674c843839c9622a722c793ab Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-833075458 Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 7e4aa5d828d24af79648ca68b3ec84c9 Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeNegativeTest-833075458-project Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.744219 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '0c09eab3-aefe-4c50-b06c-46dfd39da7a6'} Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:14.748590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. Jul 27 09:11:14.750785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:14.751905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] Returning 404 to user: Instance 0c09eab3-aefe-4c50-b06c-46dfd39da7a6 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:14.751905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5e5ed0a0-2674-4f5d-a28b-c5419e314b60 tempest-AttachVolumeNegativeTest-833075458 tempest-AttachVolumeNegativeTest-833075458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6" status: 404 len: 111 microversion: 2.1 time: 0.030708 Jul 27 09:11:14.751905 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 334/677] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:14 2022] GET /compute/v2.1/servers/0c09eab3-aefe-4c50-b06c-46dfd39da7a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:15.692390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19d8a3bb-f223-4d93-9b19-0e29bba57b6f"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:15.696447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:15.703452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:15.704024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:15.704855 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:15.705300 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:15.993637 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-158d3192-50e9-4e02-ad99-37fd04cb878f tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306657 Jul 27 09:11:16.000206 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 344/678] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:11:15 2022] POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:11:19.294007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-20f6a632-2e2d-4757-ab71-ea7bf23a9cb3 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Action: 'create', calling method: .version_select at 0x7f6f9453fee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1559059028", "metadata": {"Type": "work"}}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-20f6a632-2e2d-4757-ab71-ea7bf23a9cb3 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 122 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:19.309957 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1559059028", "metadata": {"Type": "work"}}} Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: Jul 27 09:11:19.311583 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1559059028', 'metadata': {'Type': 'work'}}}} Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise error Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.312566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 09:11:19.314195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 09:11:19.315391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 09:11:19.315391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.315391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-20f6a632-2e2d-4757-ab71-ea7bf23a9cb3 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.315391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-20f6a632-2e2d-4757-ab71-ea7bf23a9cb3 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138622 Jul 27 09:11:19.315391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 335/679] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Jul 27 09:11:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:19.324960 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9f08064a-7902-4a4f-9bc3-94a500612c18 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Action: 'create', calling method: .version_select at 0x7f6f87d24940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-465752567", "metadata": {"Type": "work"}}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9f08064a-7902-4a4f-9bc3-94a500612c18 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 119 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:19.330162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-465752567", "metadata": {"Type": "work"}}} Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:11:19.331689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-465752567', 'metadata': {'Type': 'work'}}}} Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise error Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi '0' Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.332574 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 09:11:19.333857 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 09:11:19.334941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 09:11:19.334941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.334941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9f08064a-7902-4a4f-9bc3-94a500612c18 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.334941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9f08064a-7902-4a4f-9bc3-94a500612c18 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013499 Jul 27 09:11:19.334941 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 345/680] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Jul 27 09:11:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:19.341093 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f064ca5-8357-4f55-8773-4a1846aae6c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Action: 'create', calling method: .version_select at 0x7f6f9458a1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1795524587", "metadata": {"Type": "work"}}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f064ca5-8357-4f55-8773-4a1846aae6c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 119 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:19.345282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1795524587", "metadata": {"Type": "work"}}} Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: Jul 27 09:11:19.346783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1795524587', 'metadata': {'Type': 'work'}}}} Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise error Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi '' Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.347711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 09:11:19.349322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 09:11:19.350524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 09:11:19.350524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.350524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f064ca5-8357-4f55-8773-4a1846aae6c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.350524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7f064ca5-8357-4f55-8773-4a1846aae6c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009301 Jul 27 09:11:19.350524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 336/681] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Jul 27 09:11:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:19.355836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5e47bc0e-957b-4f15-9554-0ed0f931ccfe tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Calling method '.version_select at 0x7f6f87cf90d0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:19.385925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-5e47bc0e-957b-4f15-9554-0ed0f931ccfe tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] HTTP exception thrown: Volume tempest-invalid-1764084920 could not be found. Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5e47bc0e-957b-4f15-9554-0ed0f931ccfe tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1764084920 HTTP/1.1 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:19.387899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Volume tempest-invalid-1764084920 could not be found. Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'tempest-invalid-1764084920'} Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.389425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1764084920 could not be found. (HTTP 404) (Request-ID: req-8edcdead-8aa6-4c1e-908c-5cf74ff12a29) Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.390509 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:11:19.391909 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1764084920 could not be found. Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:19.393100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1764084920 could not be found. Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1764084920 could not be found. Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5e47bc0e-957b-4f15-9554-0ed0f931ccfe tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 404 to user: Volume tempest-invalid-1764084920 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.394450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5e47bc0e-957b-4f15-9554-0ed0f931ccfe tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1764084920" status: 404 len: 99 microversion: 2.1 time: 0.037200 Jul 27 09:11:19.395454 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 346/682] 10.222.0.33 () {58 vars in 1218 bytes} [Wed Jul 27 09:11:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1764084920 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 09:11:19.400468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2759e512-d371-4e33-8590-db9881eb4253 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003755 Jul 27 09:11:19.400961 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 337/683] 10.222.0.33 () {58 vars in 1140 bytes} [Wed Jul 27 09:11:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 09:11:19.409476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ee377361-1e48-46aa-94cf-cd837b880ed9 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003756 Jul 27 09:11:19.409970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 347/684] 10.222.0.33 () {58 vars in 1137 bytes} [Wed Jul 27 09:11:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 09:11:19.417892 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1b095a80-ddda-497a-8102-c70a87efd2c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Calling method '.version_select at 0x7f6f944e2c10>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:19.450324 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-1b095a80-ddda-497a-8102-c70a87efd2c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] HTTP exception thrown: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1b095a80-ddda-497a-8102-c70a87efd2c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: DELETE /compute/v2.1/os-volumes/8e13d16f-52ca-4292-9a31-0bfe512f29ae HTTP/1.1 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:19.452985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '8e13d16f-52ca-4292-9a31-0bfe512f29ae'} Jul 27 09:11:19.454460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. (HTTP 404) (Request-ID: req-fa26a8f3-6940-44c7-92a1-f63f98a25e75) Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.455441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 09:11:19.456848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 09:11:19.458171 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1b095a80-ddda-497a-8102-c70a87efd2c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 404 to user: Volume 8e13d16f-52ca-4292-9a31-0bfe512f29ae could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1b095a80-ddda-497a-8102-c70a87efd2c0 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8e13d16f-52ca-4292-9a31-0bfe512f29ae" status: 404 len: 109 microversion: 2.1 time: 0.040153 Jul 27 09:11:19.459860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 338/685] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:11:19 2022] DELETE /compute/v2.1/os-volumes/8e13d16f-52ca-4292-9a31-0bfe512f29ae => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:19.464312 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4ae9a535-ef75-4170-a51d-b6d0e2223864 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Calling method '.version_select at 0x7f6f87d249d0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:19.491214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-4ae9a535-ef75-4170-a51d-b6d0e2223864 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] HTTP exception thrown: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4ae9a535-ef75-4170-a51d-b6d0e2223864 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Request method failure captured: Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/os-volumes/11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 HTTP/1.1 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QE3BysYcduM1sOAPSdCb-_SdzzQXEDcWIrKanjTAi2VdE-cyqRKWFl6xsxedZBt2perGUyfQxVHmJiRQhEB55yOkBJDSXM2xS3fGThH0DdNvY2Q9-sGiHmQOxMdQq63wDYHq0IIgtWbx4ypEFbmEfd0s6R8xC7E57lO6qITeB-Y3LE Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:19.493232 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f978c4e12c8a431b8100bfb8c48aa5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f978c4e12c8a431b8100bfb8c48aa5b4"}]}] Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: f978c4e12c8a431b8100bfb8c48aa5b4 Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesNegativeTest-75213702 Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: bfaad5df3e6c41278d4d1de7d811cea1 Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesNegativeTest-75213702-project Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '11651fb6-90a6-4ef2-b4d2-e87f7a3031b0'} Jul 27 09:11:19.494768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. (HTTP 404) (Request-ID: req-b910a012-8ba9-4121-ba29-291709d3bb31) Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.495725 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 09:11:19.497116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 09:11:19.498447 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4ae9a535-ef75-4170-a51d-b6d0e2223864 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] Returning 404 to user: Volume 11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4ae9a535-ef75-4170-a51d-b6d0e2223864 tempest-VolumesNegativeTest-75213702 tempest-VolumesNegativeTest-75213702-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/11651fb6-90a6-4ef2-b4d2-e87f7a3031b0" status: 404 len: 109 microversion: 2.1 time: 0.034188 Jul 27 09:11:19.499961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 348/686] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Jul 27 09:11:19 2022] GET /compute/v2.1/os-volumes/11651fb6-90a6-4ef2-b4d2-e87f7a3031b0 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:11:22.486400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b40e8c14-1dbc-4d10-97ca-d5bb5c510398 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:22.493180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b40e8c14-1dbc-4d10-97ca-d5bb5c510398 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:22.493663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b40e8c14-1dbc-4d10-97ca-d5bb5c510398 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:22.554750 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b40e8c14-1dbc-4d10-97ca-d5bb5c510398 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Going to try to stop instance {{(pid=117922) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 09:11:22.599268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b40e8c14-1dbc-4d10-97ca-d5bb5c510398 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action" status: 202 len: 0 microversion: 2.1 time: 0.117472 Jul 27 09:11:22.599915 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 339/687] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:11:22 2022] POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:11:22.611283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:22.613323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:22.615024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:22.618694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:22.619138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:22.619927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:22.620358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:22.761820 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:22.775701 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-62b5e396-0fd7-4855-b327-00036e6fe312 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.171194 Jul 27 09:11:22.776766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 349/688] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:22 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:11:23.806229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:23.806930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:23.813275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:23.813726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:23.814568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:23.815080 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:23.950116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:23.959251 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-dc774656-7ce0-4ba4-871e-5cea7a6a36db tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.157953 Jul 27 09:11:23.959944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 340/689] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:23 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:24.982157 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:24.982783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:24.989651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:24.990102 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:24.991630 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:24.992234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:25.132615 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:25.140934 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-64ee6203-00bd-49d8-87e5-6b5214a80a1d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.163047 Jul 27 09:11:25.141569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 350/690] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:24 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:26.164284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:26.164992 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:26.172003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:26.172446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:26.173217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:26.173670 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:26.310563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:26.318745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-19101d33-da19-4508-9a67-258230406be6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.158479 Jul 27 09:11:26.319412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 341/691] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:26 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:27.342489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:27.343132 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:27.349834 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:27.350278 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:27.351043 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:27.351480 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:27.486610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:27.494592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9d20911c-3ed0-4894-988b-de97a2b4da94 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.156086 Jul 27 09:11:27.495169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 351/692] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:27 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:28.520242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:28.521042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:28.527292 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:28.527782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:28.528546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:28.529074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:28.682369 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:28.692958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f18e4b45-0394-40e6-a309-959bfcf9b611 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.180448 Jul 27 09:11:28.693625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 342/693] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:28 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:29.714490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:29.715166 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:29.722463 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:29.722915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:29.723696 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:29.724162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:29.863534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:29.872021 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b6ee34c1-e0da-47ba-830f-4ddd83b5dd4b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.161311 Jul 27 09:11:29.872613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 352/694] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:29 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:30.897921 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:30.898576 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:30.907098 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:30.907620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:30.908573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:30.909007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:31.050483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:31.058703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4f0b64d5-dc63-49be-a439-5c6ea3aac881 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.164635 Jul 27 09:11:31.059287 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 343/695] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:30 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:32.081501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:32.082117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:32.089164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:32.089836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:32.090858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:32.091307 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:32.236726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:32.247607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c93229c7-fb5f-44ef-9eb4-a19c06b262cb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1721 microversion: 2.1 time: 0.168178 Jul 27 09:11:32.247607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 353/696] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:32 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:33.075391 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:33.078231 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:33.085149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.085548 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.086293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.086794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.117923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1d8ddc1b-51b8-435a-bd1e-918a44ca239c tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047003 Jul 27 09:11:33.118408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 344/697] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Jul 27 09:11:33 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:33.180506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:33.181042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:33.187812 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.188262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.189032 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.189506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.215625 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:11:33.266755 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:33.267562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:33.275815 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.276516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.277470 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.278188 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.313325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9ea69410-0e33-436c-9c2d-eb5afa40331d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 204 len: 0 microversion: 2.20 time: 0.136343 Jul 27 09:11:33.313927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 354/698] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Jul 27 09:11:33 2022] DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 09:11:33.322392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:33.323275 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:33.330760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.331375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.332361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.332803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.444961 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:33.453489 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d037cf49-7579-4c90-9f67-0fb1ba8d9b77 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1698 microversion: 2.1 time: 0.190733 Jul 27 09:11:33.463782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 345/699] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:33 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:33.478644 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-892d0b7b-529d-41a6-a11f-ccf2c2d707da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:33.496476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:33.496862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-892d0b7b-529d-41a6-a11f-ccf2c2d707da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.497339 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-892d0b7b-529d-41a6-a11f-ccf2c2d707da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.506095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:33.508084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:33.510256 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0295edc4-d4b7-42e9-9d30-8e8cbbf16ea6 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.191692 Jul 27 09:11:33.511272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 355/700] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:33 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 09:11:33.524114 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-892d0b7b-529d-41a6-a11f-ccf2c2d707da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Going to try to start instance {{(pid=117922) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 09:11:33.551345 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:33.585748 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-892d0b7b-529d-41a6-a11f-ccf2c2d707da tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action" status: 202 len: 0 microversion: 2.1 time: 0.111964 Jul 27 09:11:33.586721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 346/701] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:11:33 2022] POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:11:33.596273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:33.597164 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:33.604964 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.605498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.606389 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:33.606886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:33.759042 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:33.772973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-192f2881-4115-4ad0-87a6-9dccf249b8c9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1707 microversion: 2.1 time: 0.181454 Jul 27 09:11:33.773545 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 356/702] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:33 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1707 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:34.534899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:34.535635 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:34.542086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:34.542533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:34.543297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:34.543725 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:34.775675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:34.785290 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:34.787016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:34.788240 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-39739639-42be-43f8-a2ed-639ee18b986d tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1724 microversion: 2.20 time: 0.258201 Jul 27 09:11:34.795150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 347/703] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:34 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:11:34.808433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:34.809093 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:34.815289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:34.815732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:34.816569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:34.817007 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:35.059375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:35.068445 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5c273aa0-fcaf-434c-b4b1-02c3452207f1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1707 microversion: 2.1 time: 0.275249 Jul 27 09:11:35.082170 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 357/704] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:34 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1707 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:35.709877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-0487a408-edf8-42cc-8313-5b10431baad4 req-a19d8c74-0d6c-4a3d-b5f6-b54e59853384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4311a-0b1e-4564-9584-6b6632e59473", "name": "network-vif-deleted", "tag": "eb23da03-ac89-4552-804b-7862b63b16f8"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:11:35.724937 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-0487a408-edf8-42cc-8313-5b10431baad4 req-a19d8c74-0d6c-4a3d-b5f6-b54e59853384 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:35.725350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-0487a408-edf8-42cc-8313-5b10431baad4 req-a19d8c74-0d6c-4a3d-b5f6-b54e59853384 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:35.738368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-0487a408-edf8-42cc-8313-5b10431baad4 req-a19d8c74-0d6c-4a3d-b5f6-b54e59853384 service nova] Creating event network-vif-deleted:eb23da03-ac89-4552-804b-7862b63b16f8 for instance a3f4311a-0b1e-4564-9584-6b6632e59473 on hv-cinder-79760 Jul 27 09:11:35.743923 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-0487a408-edf8-42cc-8313-5b10431baad4 req-a19d8c74-0d6c-4a3d-b5f6-b54e59853384 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223454 Jul 27 09:11:35.744904 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 348/705] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:11:35.815374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:35.816011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:35.822876 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:35.823326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:35.824152 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:35.824595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:35.896976 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:35.900780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:35.908197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:35.910297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd793017cc53946bf91738acf42a6483c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebf61d3bcd54689abcd1334772bfa51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:35.911807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b8161dc0-5e07-4931-b3cc-ccad7a1a6928 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 200 len: 1656 microversion: 2.20 time: 0.100071 Jul 27 09:11:35.912450 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 358/706] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:35 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 09:11:36.089490 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:36.090597 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:36.098220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:36.098662 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:36.099792 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:36.100525 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:36.240428 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:11:36.250645 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-54f7f391-3da1-429c-9cf9-ae5298b620ca tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1711 microversion: 2.1 time: 0.165450 Jul 27 09:11:36.251327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 349/707] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:11:36 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1711 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:11:36.936816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:36.937607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:36.945175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:36.946019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:36.947052 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:36.947575 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:36.963989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 HTTP/1.1 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:36.965651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:36.967344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'a3f4311a-0b1e-4564-9584-6b6632e59473'} Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:36.968646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:36.970845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:36.972308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:36.972308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-881e4bc3-cb1b-436c-a3cf-39923d6b7fc0 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 404 len: 111 microversion: 2.20 time: 0.035292 Jul 27 09:11:36.972308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 359/708] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:36 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 09:11:36.977220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4ed6be66-b31d-4753-8fe8-7d751ce10455 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '.version_select at 0x7f6f945204c0>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:37.000371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4ed6be66-b31d-4753-8fe8-7d751ce10455 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592258570" status: 204 len: 0 microversion: 2.20 time: 0.026954 Jul 27 09:11:37.001063 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 350/709] 10.222.0.33 () {60 vars in 1262 bytes} [Wed Jul 27 09:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592258570 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 09:11:38.803738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:38.804260 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:38.811401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:38.811891 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:38.812703 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:38.813181 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:38.828477 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 HTTP/1.1 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:38.830047 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.831424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'a3f4311a-0b1e-4564-9584-6b6632e59473'} Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:38.832354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.833539 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.834794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:38.834794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-957c3493-7375-45fb-b1bf-c849bfeec42e tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 404 len: 111 microversion: 2.20 time: 0.031986 Jul 27 09:11:38.834794 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 360/710] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Jul 27 09:11:38 2022] DELETE /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:38.840723 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:38.841338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: a3f4311a-0b1e-4564-9584-6b6632e59473] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:38.848764 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:38.849260 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:38.850129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:38.850625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:38.864042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 HTTP/1.1 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:38.865694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.867055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'a3f4311a-0b1e-4564-9584-6b6632e59473'} Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:38.868243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. Jul 27 09:11:38.869435 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:38.870521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance a3f4311a-0b1e-4564-9584-6b6632e59473 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:38.870521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6d10d0e2-fd8d-41d2-9ae3-106306b19699 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473" status: 404 len: 111 microversion: 2.20 time: 0.031056 Jul 27 09:11:38.871147 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 351/711] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:38 2022] GET /compute/v2.1/servers/a3f4311a-0b1e-4564-9584-6b6632e59473 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:40.035440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:40.035971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:40.042499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:40.042944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:40.043705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:40.044169 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:40.058039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 HTTP/1.1 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:11:40.059573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.061886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '20213da7-326f-41bd-b775-0fb7238203e9'} Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:40.062808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.064388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.065758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:40.065758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7ae83f5f-ca2e-4cdc-a9d3-f31c5d29d551 tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 404 len: 111 microversion: 2.20 time: 0.029440 Jul 27 09:11:40.065758 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 361/712] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Jul 27 09:11:40 2022] DELETE /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:11:40.070022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:11:40.070641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] [instance: 20213da7-326f-41bd-b775-0fb7238203e9] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:11:40.077727 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:40.078170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:40.078932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:11:40.079365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:11:40.092385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] HTTP exception thrown: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Request method failure captured: Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 HTTP/1.1 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4P-4C13_KAt8QFYWZlbshVC0M6n8uXdqfZUVP4DWaWKwSQcb2_3_z6EHr-NZyOULNryzt1X3cIgD8FaHPjLEXmozfdZblxMri1X-KvD3aSGkmfZzJTXzXqCySr8lwY5_AF_eoBiOJYAryHEFKW50k4JaC5dIV5cVm0ICP0sVTTOzpi8 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:11:40.093858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebf61d3bcd54689abcd1334772bfa51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebf61d3bcd54689abcd1334772bfa51"}]}] Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: cebf61d3bcd54689abcd1334772bfa51 Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2059746126 Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: d793017cc53946bf91738acf42a6483c Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2059746126-project Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.095468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '20213da7-326f-41bd-b775-0fb7238203e9'} Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:11:40.096388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. Jul 27 09:11:40.097790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:11:40.099052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] Returning 404 to user: Instance 20213da7-326f-41bd-b775-0fb7238203e9 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:11:40.099052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6db9cbf3-2b40-4227-b675-4199092ecfad tempest-AttachVolumeShelveTestJSON-2059746126 tempest-AttachVolumeShelveTestJSON-2059746126-project] 10.222.0.33 "GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9" status: 404 len: 111 microversion: 2.20 time: 0.029021 Jul 27 09:11:40.099052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 352/713] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Jul 27 09:11:40 2022] GET /compute/v2.1/servers/20213da7-326f-41bd-b775-0fb7238203e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 09:12:07.819945 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1910923394", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "networks": [{"uuid": "47d0c85a-22da-4c36-9487-4907ff469c30"}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:07.829615 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:07.830550 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:07.880117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] validate_networks() for [('47d0c85a-22da-4c36-9487-4907ff469c30', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:12:08.286731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:12:08.287151 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:12:08.287621 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:12:08.288063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:12:08.288474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:12:08.297394 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:08.297838 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:08.298628 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:08.299062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:08.315350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Getting quotas for project 397517d8121e4c61bcf6dbc13c6abaa4. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:12:08.319282 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Getting quotas for user 90d68cc50b4d47b991a812e7443d71d1 and project 397517d8121e4c61bcf6dbc13c6abaa4. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:12:08.331845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:12:08.334044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:12:08.380739 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ca0f4a53-b7b0-4970-8421-69479864c086 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564947 Jul 27 09:12:08.381395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 362/714] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:12:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:12:08.392317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c0cdc006-92fd-470b-a377-f297b173b8d6 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:08.392937 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c0cdc006-92fd-470b-a377-f297b173b8d6 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:08.395259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:08.395965 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:08.453005 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c0cdc006-92fd-470b-a377-f297b173b8d6 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:08.461004 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c0cdc006-92fd-470b-a377-f297b173b8d6 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1214 microversion: 2.1 time: 0.072384 Jul 27 09:12:08.461590 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 353/715] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:08 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:09.483076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:09.484040 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:09.499775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:09.500309 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:09.501325 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:09.501740 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:09.580697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:09.588445 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6e1fa27b-1700-449f-9538-7f4701cd1040 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1272 microversion: 2.1 time: 0.109907 Jul 27 09:12:09.589033 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 363/716] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:09 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:10.611016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:10.611628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:10.629690 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:10.630144 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:10.630946 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:10.631388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:10.797283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-676f83ef-9a95-4fb8-be1a-f856a6e7e769 req-56526384-cb71-47fe-966d-9cc891e8ad93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4a3161-1147-49b1-a4ad-29fda61773c2", "tag": "7c1aa49d-5fd1-462b-9c0a-deff105fb587"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:10.809302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-676f83ef-9a95-4fb8-be1a-f856a6e7e769 req-56526384-cb71-47fe-966d-9cc891e8ad93 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:10.810405 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-676f83ef-9a95-4fb8-be1a-f856a6e7e769 req-56526384-cb71-47fe-966d-9cc891e8ad93 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:10.822134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-676f83ef-9a95-4fb8-be1a-f856a6e7e769 req-56526384-cb71-47fe-966d-9cc891e8ad93 service nova] Creating event network-changed:7c1aa49d-5fd1-462b-9c0a-deff105fb587 for instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 on hv-cinder-79760 Jul 27 09:12:10.828356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-676f83ef-9a95-4fb8-be1a-f856a6e7e769 req-56526384-cb71-47fe-966d-9cc891e8ad93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035926 Jul 27 09:12:10.829336 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 364/717] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:12:10.890296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:10.899259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-79435136-b6b9-44c5-9516-ab1cf05d895c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.292001 Jul 27 09:12:10.899862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 354/718] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:10 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:11.328350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:11.328862 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:11.335425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:11.335911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:11.336706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:11.337214 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:11.425691 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lazy-loading 'services' on Instance uuid d19c9de0-10fe-40cd-a028-73ab5644fc56 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:12:11.509599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1bee65fc-c7db-4740-a24e-0505a7ee36b4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments/19d8a3bb-f223-4d93-9b19-0e29bba57b6f" status: 202 len: 0 microversion: 2.1 time: 0.186258 Jul 27 09:12:11.510457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 365/719] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:12:11 2022] DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments/19d8a3bb-f223-4d93-9b19-0e29bba57b6f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:12:11.922593 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:11.923215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:11.930056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:11.930505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:11.931284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:11.931877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:12.070585 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:12.079163 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-98b8eb1a-ed43-4f42-84c2-0aaf1459f9a1 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.160303 Jul 27 09:12:12.079775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 355/720] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:11 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:13.102730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:13.103429 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:13.111138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:13.111624 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:13.112416 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:13.113154 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:13.252001 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:13.261444 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8a26c1e9-d8c2-4204-9191-dc46bac275f8 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.163151 Jul 27 09:12:13.262100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 366/721] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:13 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:13.696820 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-90ff4e90-3b8a-4bf8-97fa-1fcd5077d142 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:13.703646 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-90ff4e90-3b8a-4bf8-97fa-1fcd5077d142 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:13.704117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-90ff4e90-3b8a-4bf8-97fa-1fcd5077d142 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:13.726075 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-90ff4e90-3b8a-4bf8-97fa-1fcd5077d142 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Going to try to stop instance {{(pid=117922) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 09:12:13.769398 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-90ff4e90-3b8a-4bf8-97fa-1fcd5077d142 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action" status: 202 len: 0 microversion: 2.1 time: 0.076236 Jul 27 09:12:13.770007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 356/722] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:12:13 2022] POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:12:13.778710 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:13.779442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:13.786190 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:13.786643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:13.787423 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:13.789043 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:13.919219 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:13.926786 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-af86afce-ee88-4bcf-8a4e-60993a1c0684 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.152538 Jul 27 09:12:13.927358 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 367/723] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:13 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:14.284759 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:14.285477 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:14.291656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:14.292133 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:14.292935 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:14.293366 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:14.434751 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:14.442249 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1ce3e23e-1652-4182-9ef2-064437b4ae6c tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.161812 Jul 27 09:12:14.442812 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 357/724] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:14 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:14.948149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:14.948768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:14.956738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:14.956738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:14.957761 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:14.958240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:15.100457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:15.108634 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-55de85de-b998-447c-93aa-162170c4de04 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.164460 Jul 27 09:12:15.109194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 368/725] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:14 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:15.464176 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:15.464795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:15.471288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:15.471722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:15.472510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:15.472938 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:15.614203 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:15.622165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fc12cf6e-5525-41a8-a8ee-d20fa9963e1a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.161942 Jul 27 09:12:15.622748 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 358/726] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:15 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:16.130178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:16.130791 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:16.137730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:16.138178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:16.138943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:16.139382 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:16.271192 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:16.278726 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eb6797a5-bce6-405a-a035-193eed3803c3 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.152358 Jul 27 09:12:16.279293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 369/727] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:16 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:16.635241 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-020cfdc6-576a-48de-9a59-f453314487fc req-927b6e50-0f9d-4897-a9cc-e95183218c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4a3161-1147-49b1-a4ad-29fda61773c2", "name": "network-vif-plugged", "status": "completed", "tag": "7c1aa49d-5fd1-462b-9c0a-deff105fb587"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:16.644134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:16.645184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:16.645579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-020cfdc6-576a-48de-9a59-f453314487fc req-927b6e50-0f9d-4897-a9cc-e95183218c8d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:16.645802 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-020cfdc6-576a-48de-9a59-f453314487fc req-927b6e50-0f9d-4897-a9cc-e95183218c8d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:16.654011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:16.654524 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:16.655339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:16.657179 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:16.658017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-020cfdc6-576a-48de-9a59-f453314487fc req-927b6e50-0f9d-4897-a9cc-e95183218c8d service nova] Creating event network-vif-plugged:7c1aa49d-5fd1-462b-9c0a-deff105fb587 for instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 on hv-cinder-79760 Jul 27 09:12:16.665724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-020cfdc6-576a-48de-9a59-f453314487fc req-927b6e50-0f9d-4897-a9cc-e95183218c8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Jul 27 09:12:16.666633 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 359/728] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:12:16.810665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:16.825637 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5f7c3fbc-ada6-4d19-bebe-639c4c156692 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.184790 Jul 27 09:12:16.826175 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 370/729] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:16 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:17.300198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:17.300881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:17.307086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:17.307524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:17.308308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:17.308735 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:17.441945 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:17.449533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-72795846-6797-47c6-8954-f4504633da7a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.153559 Jul 27 09:12:17.450597 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 360/730] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:17 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:17.847374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:17.847981 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:17.854628 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:17.855081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:17.856501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:17.856961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:17.985570 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:17.993273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a2df8f08-2521-4ea5-b890-bf4e85999785 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1314 microversion: 2.1 time: 0.149849 Jul 27 09:12:17.993842 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 371/731] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:17 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:18.471205 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:18.471849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:18.474271 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:18.479328 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:18.479823 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:18.480612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:18.481651 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:18.611825 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:18.619880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-36b3e54b-224a-4b62-8b5e-1472b424bbee tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.152366 Jul 27 09:12:18.620516 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 361/732] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:18 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:19.013542 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:19.014110 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:19.015986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:19.016778 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:19.023059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.023501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.024287 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.024715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.151241 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:19.158683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4d567ff7-14b7-4959-a76b-e808869cf030 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1498 microversion: 2.1 time: 0.149192 Jul 27 09:12:19.159244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 372/733] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:19 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:19.587497 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:19.588031 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:19.594936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.595384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.596193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.596620 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.623311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:12:19.642650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:19.643250 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:19.649438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.649892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.650668 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.651106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.702863 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f6b2f3d2-302f-49c4-87f8-02923f964923 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 204 len: 0 microversion: 2.1 time: 0.118850 Jul 27 09:12:19.704061 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 362/734] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:12:19 2022] DELETE /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:12:19.713191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:19.713989 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:19.720716 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.721151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.721927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:19.722364 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:19.805970 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:19.813638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-646147b0-1dc1-456f-aeab-50f7fc17d81b tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.174716 Jul 27 09:12:19.814404 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 373/735] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:19 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:19.859078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:19.866568 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-34acaced-c19e-4968-8b23-6a3af771bcca tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1504 microversion: 2.1 time: 0.157650 Jul 27 09:12:19.867141 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 363/736] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:19 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:20.835627 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:20.836540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:20.843667 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:20.844239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:20.845168 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:20.845611 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:20.887865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:20.888467 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:20.894958 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:20.895437 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:20.896230 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:20.896656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:20.975478 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:20.984199 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bee9b606-da32-42c6-ac4e-e24d844ed282 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.152328 Jul 27 09:12:20.984698 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 374/737] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:20 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:21.026878 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:21.035206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-67848bc1-cfcb-4c72-a4af-62e774ea2c44 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1504 microversion: 2.1 time: 0.150892 Jul 27 09:12:21.035786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 364/738] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:20 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:21.613557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-c82ad505-cda0-46f0-8542-02b543fef4a0 req-1c76f63d-f7a0-4212-aef3-4bd4892d0431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4a3161-1147-49b1-a4ad-29fda61773c2", "name": "network-vif-deleted", "tag": "7c1aa49d-5fd1-462b-9c0a-deff105fb587"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:21.639089 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-c82ad505-cda0-46f0-8542-02b543fef4a0 req-1c76f63d-f7a0-4212-aef3-4bd4892d0431 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:21.639529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-c82ad505-cda0-46f0-8542-02b543fef4a0 req-1c76f63d-f7a0-4212-aef3-4bd4892d0431 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:21.651994 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-c82ad505-cda0-46f0-8542-02b543fef4a0 req-1c76f63d-f7a0-4212-aef3-4bd4892d0431 service nova] Creating event network-vif-deleted:7c1aa49d-5fd1-462b-9c0a-deff105fb587 for instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 on hv-cinder-79760 Jul 27 09:12:21.657580 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-c82ad505-cda0-46f0-8542-02b543fef4a0 req-1c76f63d-f7a0-4212-aef3-4bd4892d0431 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047937 Jul 27 09:12:21.658194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 375/739] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:12:22.004261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:22.004908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:22.011686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:22.012167 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:22.012935 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:22.013369 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:22.057847 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:22.058547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:22.071087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:22.071533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:22.072341 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:22.072950 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:22.111359 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:22.111935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:22.112626 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lazy-loading 'fault' on Instance uuid 9a4a3161-1147-49b1-a4ad-29fda61773c2 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:12:22.159580 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:22.167605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bf3ba8cc-43c5-4e98-a6af-4d0f58087854 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 200 len: 1304 microversion: 2.1 time: 0.114090 Jul 27 09:12:22.168770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 376/740] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:22 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:22.169648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:22.177394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-88cd9891-42d8-4778-a67d-17a2f8172be2 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.177081 Jul 27 09:12:22.177961 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 365/741] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:21 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:23.190131 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:23.190902 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 9a4a3161-1147-49b1-a4ad-29fda61773c2] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:23.200050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.201433 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.202135 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:23.202976 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.203226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:23.203914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.213418 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.214134 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.215944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.216675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.234077 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] HTTP exception thrown: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Request method failure captured: Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 HTTP/1.1 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QFmTpLTvx9iJ0TOaNwSxSNAPbEbsjKIZcX_MgEt0IGl9ZSBnnVrE1mI_K5fjfI9p0S6eWe0jgp01YZy5KgVIMxdQ-5ZPl8k-f8pa5xv8RCcuiQYwgHuB40kdKi-irJn7x4Y282O6GLEzZcpBK0Y9X6jCuQYZt4LOZnGQiBd1TXWHHw Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 397517d8121e4c61bcf6dbc13c6abaa4 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:12:23.237604 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/397517d8121e4c61bcf6dbc13c6abaa4"}]}] Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 397517d8121e4c61bcf6dbc13c6abaa4 Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-VolumesActionsTest-1381288616-project Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: 90d68cc50b4d47b991a812e7443d71d1 Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-VolumesActionsTest-1381288616-project Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. Jul 27 09:12:23.239167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '9a4a3161-1147-49b1-a4ad-29fda61773c2'} Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:12:23.240025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. Jul 27 09:12:23.241390 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:12:23.243137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Returning 404 to user: Instance 9a4a3161-1147-49b1-a4ad-29fda61773c2 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:12:23.243137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d37187a1-b514-4893-a11f-387208001cc0 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2" status: 404 len: 111 microversion: 2.1 time: 0.053740 Jul 27 09:12:23.243137 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 377/742] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:23 2022] GET /compute/v2.1/servers/9a4a3161-1147-49b1-a4ad-29fda61773c2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:12:23.311540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1225721135", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "networks": [{"uuid": "47d0c85a-22da-4c36-9487-4907ff469c30"}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:23.380304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] validate_networks() for [('47d0c85a-22da-4c36-9487-4907ff469c30', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:12:23.388611 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:23.396409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a990189e-d9d2-44ad-84e2-cfa7d79dd372 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1675 microversion: 2.1 time: 0.200286 Jul 27 09:12:23.397086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 366/743] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:23 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:23.728181 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:12:23.728546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:12:23.729038 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:12:23.729462 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:12:23.729844 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:12:23.738673 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.739116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.739944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:23.740374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:23.756547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Getting quotas for project 397517d8121e4c61bcf6dbc13c6abaa4. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:12:23.760678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Getting quotas for user 90d68cc50b4d47b991a812e7443d71d1 and project 397517d8121e4c61bcf6dbc13c6abaa4. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:12:23.771800 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:12:23.774018 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:12:23.819059 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-32821606-4431-448c-afa6-397ea131b7fd tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511918 Jul 27 09:12:23.819697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 378/744] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:12:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 09:12:23.830692 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-30629b56-a186-4950-827b-1a0fb8980b24 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:23.831315 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-30629b56-a186-4950-827b-1a0fb8980b24 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:23.889155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-30629b56-a186-4950-827b-1a0fb8980b24 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:23.895908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-30629b56-a186-4950-827b-1a0fb8980b24 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1214 microversion: 2.1 time: 0.069097 Jul 27 09:12:23.896484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 367/745] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:23 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:24.419506 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:24.420130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:24.426892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.427359 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.428153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.428600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.570663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:24.579023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ddf06a4e-bdf8-4f80-99c2-18ac970e12bc tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1652 microversion: 2.1 time: 0.165141 Jul 27 09:12:24.579596 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 379/746] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:24 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1652 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:24.599480 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ec72cfb4-5b7c-4055-b024-2cdf6e8d7687 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:24.606376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec72cfb4-5b7c-4055-b024-2cdf6e8d7687 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.606831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec72cfb4-5b7c-4055-b024-2cdf6e8d7687 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.631039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ec72cfb4-5b7c-4055-b024-2cdf6e8d7687 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Going to try to start instance {{(pid=117922) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 09:12:24.659103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:24.683542 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ec72cfb4-5b7c-4055-b024-2cdf6e8d7687 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action" status: 202 len: 0 microversion: 2.1 time: 0.087569 Jul 27 09:12:24.684944 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 368/747] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:12:24 2022] POST /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:12:24.693123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:24.693736 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:24.701046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.701492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.702484 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.702925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.901508 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:24.906651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:24.918220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:24.919412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:24.923398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2b4bd726-f54f-4177-9545-a5fd8b53935d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1661 microversion: 2.1 time: 0.223605 Jul 27 09:12:24.924445 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 380/748] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:24 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1661 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:24.927894 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.928564 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:24.929358 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:24.929966 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:25.010348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:25.018378 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d384933a-79bd-4062-a2f2-fd6abe63c1f3 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1272 microversion: 2.1 time: 0.104407 Jul 27 09:12:25.018967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 369/749] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:24 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:25.945780 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:25.946395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:25.954474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:25.954945 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:25.955720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:25.956231 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:26.041372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:26.041993 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:26.048953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:26.049409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:26.050188 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:26.050626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:26.106078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:26.113899 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7242b7dd-10d5-4346-82b9-32486b027ea5 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1661 microversion: 2.1 time: 0.172999 Jul 27 09:12:26.114474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 381/750] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:25 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:26.250072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-89ab6eaf-1f65-4ff1-beb1-7622975ff968 req-570711cd-9e1f-4f4b-aea7-4c5b4c8bb23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931e43e6-8354-4e19-8999-a46a615ce7bf", "tag": "559cb4b6-4687-4b4e-95c2-04569c8850a6"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:26.262213 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-89ab6eaf-1f65-4ff1-beb1-7622975ff968 req-570711cd-9e1f-4f4b-aea7-4c5b4c8bb23a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:26.262645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-89ab6eaf-1f65-4ff1-beb1-7622975ff968 req-570711cd-9e1f-4f4b-aea7-4c5b4c8bb23a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:26.274779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-89ab6eaf-1f65-4ff1-beb1-7622975ff968 req-570711cd-9e1f-4f4b-aea7-4c5b4c8bb23a service nova] Creating event network-changed:559cb4b6-4687-4b4e-95c2-04569c8850a6 for instance 931e43e6-8354-4e19-8999-a46a615ce7bf on hv-cinder-79760 Jul 27 09:12:26.280363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-89ab6eaf-1f65-4ff1-beb1-7622975ff968 req-570711cd-9e1f-4f4b-aea7-4c5b4c8bb23a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034414 Jul 27 09:12:26.280971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 382/751] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:12:26.320479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:26.329659 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3824e2bf-ecb9-453b-a52c-14f439f26166 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.293216 Jul 27 09:12:26.330648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 370/752] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:26 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:27.136590 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:27.138134 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:27.145817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:27.146244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:27.147129 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:27.147511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:27.356575 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:27.362286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:27.374678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:27.378019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:27.378970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:27.380265 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:27.565455 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:27.574935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-caee2c3b-d23a-4987-a0a4-de7fab38c681 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1665 microversion: 2.1 time: 0.442818 Jul 27 09:12:27.575817 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 383/753] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:27 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1665 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:27.660265 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:27.670106 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3c880864-5ebe-4191-88da-0efeb878a394 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.319556 Jul 27 09:12:27.670791 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 371/754] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:27 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:28.693633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:28.694627 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:28.703108 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:28.703583 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:28.704881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:28.705396 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:28.861350 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:28.870826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fe60d2a3-f28e-42ee-8469-eca0c0416e37 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.181997 Jul 27 09:12:28.871520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 384/755] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:28 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:29.897885 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:29.898517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:29.906571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:29.907454 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:29.908533 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:29.909193 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:30.287872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:30.298937 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ef74ff15-70a8-4833-99cf-59c4b956a0be tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.404786 Jul 27 09:12:30.300248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 372/756] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:29 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:31.324395 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:31.325787 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:31.342961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:31.343946 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:31.344996 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:31.345773 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:31.574533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:31.583297 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-19485c4e-b552-4afa-b9ac-9b6465612f08 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.265289 Jul 27 09:12:31.583915 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 385/757] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:31 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:32.606301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:32.607160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:32.614601 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:32.615148 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:32.616034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:32.616671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:32.818350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:32.829173 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7816af58-39da-4596-b05b-0f74d137682d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.227651 Jul 27 09:12:32.830002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 373/758] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:32 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:33.019534 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-58c1d708-ff0c-4b5c-a99b-f97fe31d5933 req-934f7c82-8a40-48a9-acac-5bf3207fe704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931e43e6-8354-4e19-8999-a46a615ce7bf", "name": "network-vif-plugged", "status": "completed", "tag": "559cb4b6-4687-4b4e-95c2-04569c8850a6"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:33.048140 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-58c1d708-ff0c-4b5c-a99b-f97fe31d5933 req-934f7c82-8a40-48a9-acac-5bf3207fe704 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:33.050069 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-58c1d708-ff0c-4b5c-a99b-f97fe31d5933 req-934f7c82-8a40-48a9-acac-5bf3207fe704 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:33.065940 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-58c1d708-ff0c-4b5c-a99b-f97fe31d5933 req-934f7c82-8a40-48a9-acac-5bf3207fe704 service nova] Creating event network-vif-plugged:559cb4b6-4687-4b4e-95c2-04569c8850a6 for instance 931e43e6-8354-4e19-8999-a46a615ce7bf on hv-cinder-79760 Jul 27 09:12:33.072208 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-58c1d708-ff0c-4b5c-a99b-f97fe31d5933 req-934f7c82-8a40-48a9-acac-5bf3207fe704 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059670 Jul 27 09:12:33.073020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 386/759] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:12:33.851017 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:33.851941 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:33.859192 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:33.859942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:33.860899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:33.861488 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:33.897500 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:34.045693 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:34.058780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-52167a8d-97c4-4fd3-9bae-9b27f0e9db6d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1314 microversion: 2.1 time: 0.211471 Jul 27 09:12:34.059835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 374/760] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:33 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:35.078581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:35.079439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:35.086461 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:35.087481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:35.096779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:35.097334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:35.098533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:35.099028 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:35.578017 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:35.590200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-57e4b5b8-d9ea-4866-b174-3eedad3b807a tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1499 microversion: 2.1 time: 0.513223 Jul 27 09:12:35.593467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 387/761] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:35 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1499 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:36.379143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:36.380278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:36.387554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:36.388248 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:36.389218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:36.389810 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:36.422600 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:12:36.523314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a5878d49-75f1-441b-a4e7-92da61850b02 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "DELETE /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 204 len: 0 microversion: 2.1 time: 0.147966 Jul 27 09:12:36.524535 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 375/762] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:12:36 2022] DELETE /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:12:36.533692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:36.534310 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:36.541268 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:36.541838 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:36.542796 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:36.543621 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:36.769061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:36.785707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-007a87f6-44ae-43f8-b04a-f1c70ccbf1ac tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1505 microversion: 2.1 time: 0.255897 Jul 27 09:12:36.786916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 388/763] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:36 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:37.811007 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:37.817461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:37.849137 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:37.849952 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:37.850988 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:37.851640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:38.151880 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:38.169612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7f0355f6-7408-47ba-950e-833286b2d24b tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1505 microversion: 2.1 time: 0.363997 Jul 27 09:12:38.174996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 376/764] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:37 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:12:38.419332 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bcacb96a-3771-4ed8-b4ea-834eb603ef02 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Action: 'create', calling method: .version_select at 0x7f6f87d24280>, body: {"keypair": {"name": "tempest-TestShelveInstance-163477883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDE20nEkPFt2I3I7XzvcYhW3X6i6KUly6TvVYC/aRpaxxRG4PCa6GziNVY58uJRRY084wn0Ak2XW9t+3obEUWsBT50Z+3YDtaskOsbwPJdQIXJUQeMVMkO9hp+750EcsRg=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:38.425183 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:38.454482 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-bcacb96a-3771-4ed8-b4ea-834eb603ef02 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Getting quotas for project f864140a6ec742f8b825251c9f0b8719. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:12:38.459969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-bcacb96a-3771-4ed8-b4ea-834eb603ef02 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Getting quotas for user 1ee82f68deab411ca74c25f3b5200fc7 and project f864140a6ec742f8b825251c9f0b8719. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:12:38.487850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bcacb96a-3771-4ed8-b4ea-834eb603ef02 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.367821 Jul 27 09:12:38.488468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 389/765] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:12:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:12:38.710743 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-356a12e9-5314-4435-825d-2d3269d73821 req-428af02c-d82d-4daf-bdb2-57e38e34b467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931e43e6-8354-4e19-8999-a46a615ce7bf", "name": "network-vif-deleted", "tag": "559cb4b6-4687-4b4e-95c2-04569c8850a6"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:38.718217 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:38.728722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-356a12e9-5314-4435-825d-2d3269d73821 req-428af02c-d82d-4daf-bdb2-57e38e34b467 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:38.730242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-356a12e9-5314-4435-825d-2d3269d73821 req-428af02c-d82d-4daf-bdb2-57e38e34b467 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:38.748406 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-356a12e9-5314-4435-825d-2d3269d73821 req-428af02c-d82d-4daf-bdb2-57e38e34b467 service nova] Creating event network-vif-deleted:559cb4b6-4687-4b4e-95c2-04569c8850a6 for instance 931e43e6-8354-4e19-8999-a46a615ce7bf on hv-cinder-79760 Jul 27 09:12:38.757628 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-356a12e9-5314-4435-825d-2d3269d73821 req-428af02c-d82d-4daf-bdb2-57e38e34b467 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051133 Jul 27 09:12:38.759777 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 377/766] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:12:39.191129 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:39.191913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:39.200558 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:39.201833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:39.202952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:39.203503 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:39.239215 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:39.239854 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:39.240421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lazy-loading 'fault' on Instance uuid 931e43e6-8354-4e19-8999-a46a615ce7bf {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:12:39.301197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d68cc50b4d47b991a812e7443d71d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397517d8121e4c61bcf6dbc13c6abaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:39.308518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fea62f34-41dd-4fb1-8394-19968bb9c921 tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 200 len: 1304 microversion: 2.1 time: 0.121956 Jul 27 09:12:39.309212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 390/767] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:39 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:12:40.331084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:40.331840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] [instance: 931e43e6-8354-4e19-8999-a46a615ce7bf] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:40.339093 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:40.339690 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:40.340487 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:40.340916 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:40.354991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] HTTP exception thrown: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Request method failure captured: Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf HTTP/1.1 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QFmTpLTvx9iJ0TOaNwSxSNAPbEbsjKIZcX_MgEt0IGl9ZSBnnVrE1mI_K5fjfI9p0S6eWe0jgp01YZy5KgVIMxdQ-5ZPl8k-f8pa5xv8RCcuiQYwgHuB40kdKi-irJn7x4Y282O6GLEzZcpBK0Y9X6jCuQYZt4LOZnGQiBd1TXWHHw Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 397517d8121e4c61bcf6dbc13c6abaa4 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:12:40.356582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/397517d8121e4c61bcf6dbc13c6abaa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/397517d8121e4c61bcf6dbc13c6abaa4"}]}] Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 397517d8121e4c61bcf6dbc13c6abaa4 Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-VolumesActionsTest-1381288616 Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-VolumesActionsTest-1381288616-project Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 90d68cc50b4d47b991a812e7443d71d1 Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-VolumesActionsTest-1381288616-project Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. Jul 27 09:12:40.358642 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '931e43e6-8354-4e19-8999-a46a615ce7bf'} Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:12:40.359840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. Jul 27 09:12:40.361417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:12:40.362821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] Returning 404 to user: Instance 931e43e6-8354-4e19-8999-a46a615ce7bf could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:12:40.362821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-da1a943a-86ce-4324-b180-ce250d06b72d tempest-VolumesActionsTest-1381288616 tempest-VolumesActionsTest-1381288616-project] 10.222.0.33 "GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf" status: 404 len: 111 microversion: 2.1 time: 0.031132 Jul 27 09:12:40.362821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 378/768] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:40 2022] GET /compute/v2.1/servers/931e43e6-8354-4e19-8999-a46a615ce7bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:12:58.241944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1177412361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-163477883", "security_groups": [{"name": "tempest-secgroup-smoke-43464690"}], "networks": [{"uuid": "04ab2f93-815e-4537-8ccd-ae9781d02910"}], "block_device_mapping_v2": [{"uuid": "01b2c807-5fbf-4e4b-9202-087813684d7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:12:58.253367 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:58.254298 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:58.255114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=48 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:58.378226 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] validate_networks() for [('04ab2f93-815e-4537-8ccd-ae9781d02910', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:12:58.773182 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:12:58.773683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:12:58.774498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:12:58.774985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:12:58.775498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:12:58.786102 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:58.786569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:58.787408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:12:58.788080 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:12:58.806426 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Getting quotas for project f864140a6ec742f8b825251c9f0b8719. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:12:58.811366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Getting quotas for user 1ee82f68deab411ca74c25f3b5200fc7 and project f864140a6ec742f8b825251c9f0b8719. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:12:58.878569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:12:58.881083 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01b2c807-5fbf-4e4b-9202-087813684d7b',volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:12:59.037680 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c8afd098-56f1-4b9e-9b65-32e2ba5175eb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.799690 Jul 27 09:12:59.040363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 391/769] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:12:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:12:59.051162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a25e14d1-d1b7-43e2-ba59-d3f1024f965b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:12:59.051772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a25e14d1-d1b7-43e2-ba59-d3f1024f965b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:12:59.055282 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:59.055940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:59.166274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a25e14d1-d1b7-43e2-ba59-d3f1024f965b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:12:59.179573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a25e14d1-d1b7-43e2-ba59-d3f1024f965b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1088 microversion: 2.1 time: 0.132019 Jul 27 09:12:59.193241 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 379/770] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:12:59 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1088 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:00.202527 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:00.203294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:00.213807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:00.216237 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:00.217306 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:00.221050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:00.312672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:00.320689 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-05141ccd-82f6-425a-9786-7170375178cb tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1194 microversion: 2.1 time: 0.123604 Jul 27 09:13:00.321451 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 392/771] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:00 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:01.342364 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:01.342889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:01.350779 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:01.351507 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:01.352604 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:01.353249 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:01.618889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:01.639733 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6f541701-049e-4cef-a29f-3dd26279545f tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.300945 Jul 27 09:13:01.641094 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 380/772] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:01 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:02.012770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-7c671a64-2e00-4101-9449-ff5cd90ed9da req-41f92252-4cbc-4c8c-b98a-add57ffabd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:02.034969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-7c671a64-2e00-4101-9449-ff5cd90ed9da req-41f92252-4cbc-4c8c-b98a-add57ffabd25 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:02.035410 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-7c671a64-2e00-4101-9449-ff5cd90ed9da req-41f92252-4cbc-4c8c-b98a-add57ffabd25 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:02.064510 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-7c671a64-2e00-4101-9449-ff5cd90ed9da req-41f92252-4cbc-4c8c-b98a-add57ffabd25 service nova] Creating event network-changed:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:13:02.071096 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-7c671a64-2e00-4101-9449-ff5cd90ed9da req-41f92252-4cbc-4c8c-b98a-add57ffabd25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062981 Jul 27 09:13:02.072263 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 393/773] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:02.663699 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:02.664434 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:02.681624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:02.681624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:02.681624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:02.681624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:02.850125 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:02.858108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3c3918d9-7f12-4554-bc90-814b8daa17ce tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.199515 Jul 27 09:13:02.858684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 381/774] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:02 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:03.881803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:03.882538 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:03.890155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:03.890605 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:03.891374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:03.891843 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:04.031640 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:04.039344 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6884cd99-21b9-4b0f-8ae9-ffdc015f3c19 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.161864 Jul 27 09:13:04.039951 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 394/775] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:03 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:05.061691 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:05.062220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:05.068207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:05.068649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:05.069409 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:05.069844 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:05.209783 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:05.217311 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-66eda5d7-f846-4e57-9896-811c9abbb0ac tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.160788 Jul 27 09:13:05.218101 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 382/776] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:05 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:06.040492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:06.043205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:06.050609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.051060 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.051864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.052306 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.083315 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-45470fa8-c91c-4746-adfd-053e98c4c89e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047177 Jul 27 09:13:06.084120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 395/777] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:13:06 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:13:06.149517 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:06.150066 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:06.157100 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.157543 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.158302 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.158733 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.185510 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:13:06.239927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:06.240711 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:06.249488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.250148 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.251739 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.252219 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.268763 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-895f5964-d267-458e-9b33-22732a8baef9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 204 len: 0 microversion: 2.1 time: 0.122836 Jul 27 09:13:06.269951 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 383/778] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:13:06 2022] DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:13:06.279210 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:06.280071 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:06.286836 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.287638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.288546 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:06.289031 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:06.408769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:06.416861 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-74b092ec-c5a8-433f-8a61-55186348e956 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.182079 Jul 27 09:13:06.417434 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 396/779] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:06 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:13:06.663086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:06.672571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0bbb1ec8-70c9-4de5-ac59-b2a709f59457 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1671 microversion: 2.1 time: 0.398192 Jul 27 09:13:06.673670 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 384/780] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:06 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:13:07.438409 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:07.439181 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:07.445881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:07.446331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:07.447110 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:07.447633 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:07.582006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:07.589470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-252a9651-4ced-49ff-bc06-cb5c51668fbe tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.154939 Jul 27 09:13:07.590231 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 397/781] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:07 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:07.695788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:07.696504 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:07.706855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:07.706855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:07.706855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:07.706855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:07.842673 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:07.850143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f1305a39-4c30-48f7-bf4c-d68ef9b0a653 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1671 microversion: 2.1 time: 0.159232 Jul 27 09:13:07.850726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 385/782] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:07 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:08.611491 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:08.613521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:08.624765 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:08.625216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:08.641023 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:08.641714 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:08.800595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:08.803326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:08.812095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a1a7b46b-492b-4237-a310-e1a3b0845a49 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.204698 Jul 27 09:13:08.813414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 398/783] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:08 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:08.874143 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:08.875434 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:08.883050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:08.883501 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:08.884298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:08.884733 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:09.172483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:09.255610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:09.265105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c5e120e3-034c-43c7-90fe-863dfedb68cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1671 microversion: 2.1 time: 0.395408 Jul 27 09:13:09.265987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 386/784] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:08 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:09.837227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:09.838559 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:09.844916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:09.847862 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:09.848400 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:09.849818 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:09.850321 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:10.000552 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:10.008833 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1b2def78-f909-4a22-9e06-9c11f357deec tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.176417 Jul 27 09:13:10.009717 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 399/785] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:09 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:10.217730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-c6d2aca9-e8f6-4590-baa6-f4668c7dea53 req-6d8fc875-a035-4bc1-a6ea-00ef1d1502a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19c9de0-10fe-40cd-a028-73ab5644fc56", "name": "network-vif-deleted", "tag": "32b599c1-00f0-467f-b4d8-741ad2979692"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:10.232006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-c6d2aca9-e8f6-4590-baa6-f4668c7dea53 req-6d8fc875-a035-4bc1-a6ea-00ef1d1502a2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:10.232622 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-c6d2aca9-e8f6-4590-baa6-f4668c7dea53 req-6d8fc875-a035-4bc1-a6ea-00ef1d1502a2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:10.264348 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-c6d2aca9-e8f6-4590-baa6-f4668c7dea53 req-6d8fc875-a035-4bc1-a6ea-00ef1d1502a2 service nova] Creating event network-vif-deleted:32b599c1-00f0-467f-b4d8-741ad2979692 for instance d19c9de0-10fe-40cd-a028-73ab5644fc56 on hv-cinder-79760 Jul 27 09:13:10.281760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-c6d2aca9-e8f6-4590-baa6-f4668c7dea53 req-6d8fc875-a035-4bc1-a6ea-00ef1d1502a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068545 Jul 27 09:13:10.282731 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 387/786] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:13:10.290889 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:10.291841 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:10.303120 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:10.312606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:10.313850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:10.314481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:10.414238 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:10.423249 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-73551f28-5a46-4cb2-85d6-3768d55f8d2e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 200 len: 1321 microversion: 2.1 time: 0.138392 Jul 27 09:13:10.424656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 400/787] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:10 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 1321 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:13:11.032624 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:11.033702 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:11.044222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:11.045259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:11.046447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:11.047114 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:11.321240 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:11.337853 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1dc20476-b707-4209-97d8-868de43a1920 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.311899 Jul 27 09:13:11.353379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 388/788] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:11 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:11.445495 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:11.446832 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:11.454513 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:11.455363 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:11.456414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:11.457055 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:11.473846 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 HTTP/1.1 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:13:11.476123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:13:11.477537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'd19c9de0-10fe-40cd-a028-73ab5644fc56'} Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:13:11.478299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:13:11.480144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:13:11.482751 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:13:11.483882 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-345d9dcf-d3fc-4e3c-81c6-adc046726e54 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 404 len: 111 microversion: 2.1 time: 0.042455 Jul 27 09:13:11.485176 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 401/789] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:11 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:13:11.494142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d2bb445d-26c3-41ee-86b2-69a48faf1306 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '.version_select at 0x7f6f9454c160>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:11.522837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d2bb445d-26c3-41ee-86b2-69a48faf1306 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904088583" status: 202 len: 0 microversion: 2.1 time: 0.032795 Jul 27 09:13:11.541081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 389/790] 10.222.0.33 () {58 vars in 1218 bytes} [Wed Jul 27 09:13:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904088583 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:13:11.685143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-943e4aac-f3a8-4bf5-891f-dc6fe1150e2f req-3cd0c7aa-3f3a-421b-a8bd-6516c329adf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "name": "network-vif-plugged", "status": "completed", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:11.706511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-943e4aac-f3a8-4bf5-891f-dc6fe1150e2f req-3cd0c7aa-3f3a-421b-a8bd-6516c329adf6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:11.707016 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-943e4aac-f3a8-4bf5-891f-dc6fe1150e2f req-3cd0c7aa-3f3a-421b-a8bd-6516c329adf6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:11.736314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-943e4aac-f3a8-4bf5-891f-dc6fe1150e2f req-3cd0c7aa-3f3a-421b-a8bd-6516c329adf6 service nova] Creating event network-vif-plugged:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:13:11.750662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-943e4aac-f3a8-4bf5-891f-dc6fe1150e2f req-3cd0c7aa-3f3a-421b-a8bd-6516c329adf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070083 Jul 27 09:13:11.753708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 402/791] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:12.370580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:12.373084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:12.388878 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:12.389926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:12.391615 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:12.393029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:12.814657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:12.825621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-673deefa-1669-4a4c-84e9-04169e6f1263 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1258 microversion: 2.1 time: 0.470250 Jul 27 09:13:12.826554 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 390/792] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:12 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1258 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:13.063108 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-273ceb99-8d1c-4579-b01b-19859c53a337 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: .version_select at 0x7f6f87cabc10>, body: {"keypair": {"name": "tempest-keypair-1424784683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgw+M3Sc0zCMT+UNfAlHDvWwq+Atnho2qiLcwQfloog/i5Z6OiB6EG8dUx0gq/4X1m0bNVTL51GKMtDg6pYhCzU/zyNkDVJMV9VPIiBkDeWFtxvIC8CSAdOQ1WvbJad0g=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:13.095531 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-273ceb99-8d1c-4579-b01b-19859c53a337 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:13:13.102592 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-273ceb99-8d1c-4579-b01b-19859c53a337 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for user c1512e7653d140d9a14d3981a8215969 and project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:13:13.133932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-273ceb99-8d1c-4579-b01b-19859c53a337 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080472 Jul 27 09:13:13.138576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 403/793] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:13:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:13.846389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:13.847082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:13.853670 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:13.854198 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:13.854870 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:13.855298 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:14.096422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:14.103943 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fcd8c51d-a15f-4d80-899a-84f2ed0b5cb2 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1442 microversion: 2.1 time: 0.261229 Jul 27 09:13:14.106445 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 391/794] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:13 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1442 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:14.131429 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:14.132590 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:14.140697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:14.141286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:14.143328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:14.144322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:14.358479 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:14.367901 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b122a645-ca4e-462e-9b02-da35e6afbeed tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1442 microversion: 2.1 time: 0.243832 Jul 27 09:13:14.369091 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 404/795] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:14 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1442 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:15.279382 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-53626104", "imageRef": "c4d52661-3197-4d38-b570-a8a6f13c98c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c63381ac-c660-4a56-bcaf-3c3c72451253"}], "security_groups": [{"name": "tempest-securitygroup--1069806292"}], "key_name": "tempest-keypair-1424784683", "user_data": "}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:15.415225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] validate_networks() for [('c63381ac-c660-4a56-bcaf-3c3c72451253', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:13:16.576278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:13:16.576902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:13:16.577626 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:13:16.578113 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:13:16.579602 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:13:16.600840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:16.601473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:16.620704 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:16.622322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:16.688816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:13:16.698503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Getting quotas for user c1512e7653d140d9a14d3981a8215969 and project 5a8f4f43cb3a43a8b67e44df564db90f. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:13:16.714289 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:13:16.716991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4d52661-3197-4d38-b570-a8a6f13c98c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:13:16.794288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR oslo.messaging._drivers.impl_rabbit [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [c87bd5a7-f9eb-467e-bca8-b902fcaf1ee3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 09:13:17.808165 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [c87bd5a7-f9eb-467e-bca8-b902fcaf1ee3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55450. Jul 27 09:13:17.818747 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-fb7ae622-edf2-4662-b543-36c6424103f5 req-c328da94-3fba-4104-92df-6376dcf8e54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:17.821250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-683144a4-6e92-4d7e-af40-e31c4470bc3d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.546185 Jul 27 09:13:17.823588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 392/796] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:13:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:13:17.843835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bf327d45-aca4-4c96-879b-d9e68ea70ab4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:17.844766 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bf327d45-aca4-4c96-879b-d9e68ea70ab4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:17.845371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fb7ae622-edf2-4662-b543-36c6424103f5 req-c328da94-3fba-4104-92df-6376dcf8e54b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:17.845837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fb7ae622-edf2-4662-b543-36c6424103f5 req-c328da94-3fba-4104-92df-6376dcf8e54b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:17.876044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-fb7ae622-edf2-4662-b543-36c6424103f5 req-c328da94-3fba-4104-92df-6376dcf8e54b service nova] Creating event network-changed:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:13:17.886821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-fb7ae622-edf2-4662-b543-36c6424103f5 req-c328da94-3fba-4104-92df-6376dcf8e54b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073904 Jul 27 09:13:17.887438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 405/797] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:18.069847 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bf327d45-aca4-4c96-879b-d9e68ea70ab4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:18.078246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bf327d45-aca4-4c96-879b-d9e68ea70ab4 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1236 microversion: 2.1 time: 0.248854 Jul 27 09:13:18.084078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 393/798] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:17 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1236 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:19.099552 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:19.100280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:19.121530 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:19.122330 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:19.125738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:19.126588 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:19.223598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:19.241852 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-450040c9-c2c8-442e-a2e7-12eef6eb158e tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1288 microversion: 2.1 time: 0.143032 Jul 27 09:13:19.245838 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 406/799] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:19 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1288 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:20.264394 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:20.265676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:20.274057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:20.274338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:20.277277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:20.277798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:20.371684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:20.383286 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-06a66a28-2e66-40bb-9853-3e1126b48093 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1294 microversion: 2.1 time: 0.122780 Jul 27 09:13:20.391891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 394/800] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:20 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:21.406435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:21.408423 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:21.416752 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:21.420090 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:21.423283 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:21.423952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:21.757332 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:21.774821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-7ac1ed49-0d9a-4da5-8d7f-787eb44a13a0 req-85c9bb9b-2b47-4915-ba3e-60a1ce6afac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacba783-98be-4165-80de-6e48a7f62151", "tag": "0b53e558-b738-49e3-b2bd-209273bc6b9a"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:21.801494 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-83954304-a47e-4148-91ac-cc018c2e4ac8 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1362 microversion: 2.1 time: 0.398874 Jul 27 09:13:21.803066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 407/801] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:21 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:21.809052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7ac1ed49-0d9a-4da5-8d7f-787eb44a13a0 req-85c9bb9b-2b47-4915-ba3e-60a1ce6afac5 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:21.809819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-7ac1ed49-0d9a-4da5-8d7f-787eb44a13a0 req-85c9bb9b-2b47-4915-ba3e-60a1ce6afac5 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:21.825983 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-7ac1ed49-0d9a-4da5-8d7f-787eb44a13a0 req-85c9bb9b-2b47-4915-ba3e-60a1ce6afac5 service nova] Creating event network-changed:0b53e558-b738-49e3-b2bd-209273bc6b9a for instance aacba783-98be-4165-80de-6e48a7f62151 on hv-cinder-79760 Jul 27 09:13:21.832910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-7ac1ed49-0d9a-4da5-8d7f-787eb44a13a0 req-85c9bb9b-2b47-4915-ba3e-60a1ce6afac5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062958 Jul 27 09:13:21.834472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 395/802] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:22.823875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:22.825198 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:22.838645 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:22.839486 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:22.840584 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:22.841227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:23.107579 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:23.114424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:23.117468 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-751f5b71-16ac-4878-b871-c210928948ae tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1362 microversion: 2.1 time: 0.297675 Jul 27 09:13:23.119291 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 408/803] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:22 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:24.142993 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:24.143859 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:24.151147 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:24.151896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:24.152838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:24.155581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:24.305967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:24.313938 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d964756a-c823-4bf1-8525-2a94d266c7cf tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1362 microversion: 2.1 time: 0.175573 Jul 27 09:13:24.327261 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 396/804] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:24 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:25.334477 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:25.338505 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:25.348881 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:25.350347 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:25.351376 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:25.352594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:25.428425 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-23bb4edd-ab6d-4a0a-8580-d3f15e0d5d1a req-ae545af0-88f6-469b-b0cf-84d2f77947e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacba783-98be-4165-80de-6e48a7f62151", "name": "network-vif-plugged", "status": "completed", "tag": "0b53e558-b738-49e3-b2bd-209273bc6b9a"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:25.457922 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-23bb4edd-ab6d-4a0a-8580-d3f15e0d5d1a req-ae545af0-88f6-469b-b0cf-84d2f77947e0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:25.458377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-23bb4edd-ab6d-4a0a-8580-d3f15e0d5d1a req-ae545af0-88f6-469b-b0cf-84d2f77947e0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:25.488408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-23bb4edd-ab6d-4a0a-8580-d3f15e0d5d1a req-ae545af0-88f6-469b-b0cf-84d2f77947e0 service nova] Creating event network-vif-plugged:0b53e558-b738-49e3-b2bd-209273bc6b9a for instance aacba783-98be-4165-80de-6e48a7f62151 on hv-cinder-79760 Jul 27 09:13:25.497663 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-23bb4edd-ab6d-4a0a-8580-d3f15e0d5d1a req-ae545af0-88f6-469b-b0cf-84d2f77947e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080516 Jul 27 09:13:25.502224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 397/805] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:25.632367 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:25.644051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-37ce6fb1-a085-4e30-8828-6045a72501eb tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1362 microversion: 2.1 time: 0.313301 Jul 27 09:13:25.648323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 409/806] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:25 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:26.665798 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:26.670983 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:26.672081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:26.680794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:26.681785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:26.682570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:26.683417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:26.888160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:26.899872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-53bfa271-3d6b-44e1-ab16-200e55b7be12 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1362 microversion: 2.1 time: 0.235331 Jul 27 09:13:26.901065 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 398/807] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:26 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:27.922831 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:27.924180 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:27.933106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:27.933972 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:27.934949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:27.935569 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:28.080731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:28.089582 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-43835d6f-f1b0-49d5-b7b0-d465d4c7bc49 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1547 microversion: 2.1 time: 0.171625 Jul 27 09:13:28.105890 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 410/808] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:27 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:28.111616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:28.112179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:28.117940 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=8 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:28.120630 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:28.121422 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:28.122368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:28.122969 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:28.300585 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:28.373191 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-70cab650-7912-4e53-a1f6-45ec0f8f3f38 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265613 Jul 27 09:13:28.374299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 399/809] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Jul 27 09:13:28 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:29.447892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-0de503e5-8938-49e6-a08d-102181775138 req-2eb706c5-728c-4ceb-a91f-83d9313233d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacba783-98be-4165-80de-6e48a7f62151", "tag": "0b53e558-b738-49e3-b2bd-209273bc6b9a"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:29.457237 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:29.459065 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0de503e5-8938-49e6-a08d-102181775138 req-2eb706c5-728c-4ceb-a91f-83d9313233d0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:29.462851 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-0de503e5-8938-49e6-a08d-102181775138 req-2eb706c5-728c-4ceb-a91f-83d9313233d0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:29.477369 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=95 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:29.481308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-0de503e5-8938-49e6-a08d-102181775138 req-2eb706c5-728c-4ceb-a91f-83d9313233d0 service nova] Creating event network-changed:0b53e558-b738-49e3-b2bd-209273bc6b9a for instance aacba783-98be-4165-80de-6e48a7f62151 on hv-cinder-79760 Jul 27 09:13:29.487411 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-0de503e5-8938-49e6-a08d-102181775138 req-2eb706c5-728c-4ceb-a91f-83d9313233d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043330 Jul 27 09:13:29.488848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 411/810] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:13:31.182667 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b293b912-f497-4791-9cdf-d899e7981c39 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'create', calling method: .version_select at 0x7f6f94488430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2005941094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn/vCNdjyTAYrC9JwkoCE/IHC6rwBVFjav25wyGN7s87z8DB+4L6gWPpK/GEEcipLy06Hfw66vXFvVYodJqgwgOWRLRZSYkg1pqNKYMeUFb45Mh8O5c0oTGw0qistzZDw=="}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:31.187977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:31.201757 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-b293b912-f497-4791-9cdf-d899e7981c39 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Getting quotas for project 194387beb32449da80a42f5c2e66aa12. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:13:31.206410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-b293b912-f497-4791-9cdf-d899e7981c39 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Getting quotas for user cddaad3615f041b59a87547386049309 and project 194387beb32449da80a42f5c2e66aa12. Resources: {'key_pairs'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:13:31.228022 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b293b912-f497-4791-9cdf-d899e7981c39 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050187 Jul 27 09:13:31.228625 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 400/811] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:13:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:31.279512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-233632079", "imageRef": "3317f232-5e66-42f5-af51-a70c47f48901", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2005941094", "networks": [{"uuid": "4287b355-c71b-4833-8eef-b3a5a912658c"}]}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:31.340417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.network.neutron [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] validate_networks() for [('4287b355-c71b-4833-8eef-b3a5a912658c', None, None, None, None, None)] {{(pid=117923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:13:31.711932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Flavor limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:13:31.712904 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Image limits 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:13:31.713375 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Flavor pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:13:31.713783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Image pref 0:0:0 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:13:31.714227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.virt.hardware [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:13:31.723393 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:31.723875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:31.724681 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:31.725124 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:31.742155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Getting quotas for project 194387beb32449da80a42f5c2e66aa12. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:13:31.747233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Getting quotas for user cddaad3615f041b59a87547386049309 and project 194387beb32449da80a42f5c2e66aa12. Resources: {'instances', 'cores', 'ram'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:13:31.758276 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Going to run 1 instances... {{(pid=117923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:13:31.760581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3317f232-5e66-42f5-af51-a70c47f48901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:13:31.808588 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a27d731a-b2ad-4b76-bc7c-be925c93d217 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533537 Jul 27 09:13:31.809245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 412/812] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:13:31.820020 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-1d081813-825b-4fc9-9a04-3eab61577b9a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:31.820676 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-1d081813-825b-4fc9-9a04-3eab61577b9a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:31.873011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-1d081813-825b-4fc9-9a04-3eab61577b9a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:31.880769 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-1d081813-825b-4fc9-9a04-3eab61577b9a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1258 microversion: 2.1 time: 0.064607 Jul 27 09:13:31.881340 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 401/813] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:31 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:32.903775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:32.906864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:32.913601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:32.914299 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:32.915272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:32.915888 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:32.997922 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:33.007856 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-eb561a06-301b-4ea0-bcd3-abeeda08512c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1316 microversion: 2.1 time: 0.108761 Jul 27 09:13:33.019923 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 413/814] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:32 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:34.032857 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:34.034195 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:34.042432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:34.043235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:34.044417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:34.045073 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:34.192616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:34.201921 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-483a276c-5e6f-4f34-9206-3a5686991869 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.173140 Jul 27 09:13:34.208444 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 402/815] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:34 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:35.228783 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:35.229398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:35.236031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:35.236483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:35.237259 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:35.237695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:35.374614 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:35.385858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2e63dea4-17ac-409e-a5fb-83ebbbc857f1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.160843 Jul 27 09:13:35.386699 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 414/816] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:35 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:36.406493 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:36.407959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:36.416046 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:36.416587 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:36.417364 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:36.417789 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:36.561008 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:36.568496 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c2a95db6-c2f5-447c-8ba0-3eaa86c0ddd5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.165848 Jul 27 09:13:36.573285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 403/817] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:36 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:37.589474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:37.590095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:37.596235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:37.596719 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:37.597499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:37.597933 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:37.739707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:37.748944 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9bc7f3ea-1119-4db0-8fa2-62a2b7d6f1b8 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.163391 Jul 27 09:13:37.751916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 415/818] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:37 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:38.771538 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:38.772649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:38.779805 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:38.780278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:38.781179 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:38.781722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:38.922768 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:38.931270 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-00682d87-8556-4c80-a4c4-07267d9238cb tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.163885 Jul 27 09:13:38.932064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 404/819] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:38 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:39.952607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:39.953279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:39.961583 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:39.962063 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:39.962848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:39.963343 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:40.101011 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:40.109600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a92c0005-293a-4869-8986-93cbef683492 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.160962 Jul 27 09:13:40.110181 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 416/820] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:39 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:41.131424 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:41.132066 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:41.139243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:41.139695 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:41.140491 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:41.140929 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:41.273308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:41.280849 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-42d7bc54-d362-4a8f-bda6-3135a9b2316d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.153368 Jul 27 09:13:41.281426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 405/821] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:41 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:42.066498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-a1a4a359-b441-49c4-b590-f32fbfc208f1 req-0853b236-3536-4fab-99c1-d46e6e0eabf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:42.072161 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:42.073897 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=6 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:42.083551 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a1a4a359-b441-49c4-b590-f32fbfc208f1 req-0853b236-3536-4fab-99c1-d46e6e0eabf1 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:42.084084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-a1a4a359-b441-49c4-b590-f32fbfc208f1 req-0853b236-3536-4fab-99c1-d46e6e0eabf1 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:42.097028 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-a1a4a359-b441-49c4-b590-f32fbfc208f1 req-0853b236-3536-4fab-99c1-d46e6e0eabf1 service nova] Creating event network-changed:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:13:42.103204 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-a1a4a359-b441-49c4-b590-f32fbfc208f1 req-0853b236-3536-4fab-99c1-d46e6e0eabf1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041401 Jul 27 09:13:42.104174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 417/822] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:42.302267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:42.302888 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:42.304773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=6 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:42.311366 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:42.311848 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:42.312605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:42.313739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:42.449580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:42.457288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fc63bddd-b5ea-4b0a-b47a-d2fdc871bea0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.158822 Jul 27 09:13:42.457941 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 406/823] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:42 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:43.479643 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:43.480513 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:43.487285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:43.487738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:43.488553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:43.488991 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:43.966927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:43.974612 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cceb512a-32bc-46f2-b0f1-e9859bf29bb9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.499864 Jul 27 09:13:43.975184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 418/824] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:43 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:44.997078 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:44.997675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:45.003947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:45.004385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:45.005138 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:45.005566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:45.136244 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:45.144595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6fc834c3-8fb3-48ee-8f78-4444f70c6243 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.152098 Jul 27 09:13:45.145235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 407/825] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:44 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:45.472966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-28d5b30b-7186-4ade-b98b-0be168caedce req-4c89584d-8f8e-4acc-ab6d-f4beb78d8804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "name": "network-vif-plugged", "status": "completed", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:45.483722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-28d5b30b-7186-4ade-b98b-0be168caedce req-4c89584d-8f8e-4acc-ab6d-f4beb78d8804 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:45.484195 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-28d5b30b-7186-4ade-b98b-0be168caedce req-4c89584d-8f8e-4acc-ab6d-f4beb78d8804 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:45.495952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-28d5b30b-7186-4ade-b98b-0be168caedce req-4c89584d-8f8e-4acc-ab6d-f4beb78d8804 service nova] Creating event network-vif-plugged:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:13:45.500600 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-28d5b30b-7186-4ade-b98b-0be168caedce req-4c89584d-8f8e-4acc-ab6d-f4beb78d8804 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Jul 27 09:13:45.501198 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 419/826] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:46.165996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:46.166588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:46.172994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:46.173452 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:46.174189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:46.174639 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:46.306116 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:46.313490 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-26c161fb-c682-4626-bddc-960b46a54eda tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1358 microversion: 2.1 time: 0.151942 Jul 27 09:13:46.314051 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 408/827] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:46 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:47.335504 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:47.336266 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:47.343279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.343801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.344588 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.345021 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.476139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:47.483776 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-03407cce-0257-406e-ae33-1ea89c85182c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1548 microversion: 2.1 time: 0.152932 Jul 27 09:13:47.484381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 420/828] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:47 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:47.503950 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:47.504603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:47.512079 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.512530 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.513303 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.513742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.641214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:47.648784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-bfe5302b-9f93-4e54-bce0-c95ef17f4ecf tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1548 microversion: 2.1 time: 0.148958 Jul 27 09:13:47.649363 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 409/829] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:47 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:47.668896 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:47.673533 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:47.674302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Searching by: {'deleted': False, 'project_id': '194387beb32449da80a42f5c2e66aa12'} {{(pid=117923) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 27 09:13:47.681674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.682123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.682924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.683361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.776930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.multi_cell_list [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117923) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 09:13:47.871654 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-22f45950-152a-4f11-b8fe-8c896de5ca25 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206641 Jul 27 09:13:47.872198 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 421/830] 10.222.0.33 () {58 vars in 1125 bytes} [Wed Jul 27 09:13:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:47.884648 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:47.885259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:47.891537 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.892024 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:47.892785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:47.893236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:48.026707 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:48.034226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6ab157f8-ba42-406f-99c9-a16805cc64d0 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1548 microversion: 2.1 time: 0.154308 Jul 27 09:13:48.034793 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 410/831] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:47 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:49.587562 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8fb8317-eac1-4cda-bef3-32598d7cec46"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:49.590024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:49.596727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:49.597174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:49.597945 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:49.598387 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:49.835421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fa6c4b9d-c31e-4d8f-a9fa-d9e429bf7955 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252491 Jul 27 09:13:49.836075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 422/832] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:13:49 2022] POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:13:57.438483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:13:57.439136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:13:57.446419 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:57.446867 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:57.447635 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:57.448177 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:57.583318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:13:57.591819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-c7dda26a-573a-4bde-bb2a-f97b97d1e46c tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1594 microversion: 2.1 time: 0.157047 Jul 27 09:13:57.592385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 411/833] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:13:57 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:13:59.240692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:59.246102 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-3cb06b7a-fb9c-4fc3-b1c5-6f446a6892d1 req-bd918a07-8e58-4996-9bd7-e18142f3c3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:13:59.257343 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-3cb06b7a-fb9c-4fc3-b1c5-6f446a6892d1 req-bd918a07-8e58-4996-9bd7-e18142f3c3a6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:13:59.258200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-3cb06b7a-fb9c-4fc3-b1c5-6f446a6892d1 req-bd918a07-8e58-4996-9bd7-e18142f3c3a6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:13:59.270394 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-3cb06b7a-fb9c-4fc3-b1c5-6f446a6892d1 req-bd918a07-8e58-4996-9bd7-e18142f3c3a6 service nova] Creating event network-changed:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:13:59.275928 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-3cb06b7a-fb9c-4fc3-b1c5-6f446a6892d1 req-bd918a07-8e58-4996-9bd7-e18142f3c3a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036839 Jul 27 09:13:59.276566 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 423/834] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:00.269991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1450148276"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:00.270665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:00.277974 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:00.278555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:00.279411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:00.279879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:00.282343 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=61 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:00.415235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.network.security_group_api [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Adding security group 134926b2-5dfe-4755-834c-9d0f8fc9bdbb to port 75b9880c-6980-41f1-93af-64ea0b224e08 Jul 27 09:14:00.792066 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ffd849a7-2da8-41ee-a7f9-3b65f930c985 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action" status: 202 len: 0 microversion: 2.1 time: 0.526036 Jul 27 09:14:00.798780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 412/835] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:14:00 2022] POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:14:00.805311 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:00.806470 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-e88cccfa-8c75-400b-8c27-2504b7f97cfc req-a5316f8b-1be3-4c38-a25d-4461ecd6954a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:00.809986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:00.818212 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:00.818913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:00.820031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:00.821958 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:00.838481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-e88cccfa-8c75-400b-8c27-2504b7f97cfc req-a5316f8b-1be3-4c38-a25d-4461ecd6954a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:00.839284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-e88cccfa-8c75-400b-8c27-2504b7f97cfc req-a5316f8b-1be3-4c38-a25d-4461ecd6954a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:00.858053 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-e88cccfa-8c75-400b-8c27-2504b7f97cfc req-a5316f8b-1be3-4c38-a25d-4461ecd6954a service nova] Creating event network-changed:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:14:00.863939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-e88cccfa-8c75-400b-8c27-2504b7f97cfc req-a5316f8b-1be3-4c38-a25d-4461ecd6954a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063645 Jul 27 09:14:00.868521 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 413/836] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:01.101135 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:01.110338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-38c4f6d7-0a8c-4286-9e44-6ddcf2799a83 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1760 microversion: 2.1 time: 0.312371 Jul 27 09:14:01.111388 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 424/837] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:00 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1760 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:05.663633 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:05.664274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:05.666665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:05.672170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:05.672654 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:05.673426 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:05.673861 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:05.698826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-20d5d870-89ab-411d-bd8f-178c4bfa923d tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/ips" status: 200 len: 145 microversion: 2.1 time: 0.039311 Jul 27 09:14:05.699427 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 414/838] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Jul 27 09:14:05 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:07.027195 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "507acbcc-1921-4094-9429-b97e19f91c04"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:07.029500 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:07.031912 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:07.037027 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:07.037485 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:07.038258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:07.039209 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:07.043908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:07.282326 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5bf9dd70-d1b4-4990-a3c3-aa42ad53e535 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258793 Jul 27 09:14:07.282966 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 425/839] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:14:07 2022] POST /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:13.764678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:13.767023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:13.773643 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:13.774091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:13.774860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:13.775296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:13.805683 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3e9de94b-7cf6-4316-bad4-80059f8d63c1 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045253 Jul 27 09:14:13.806272 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 415/840] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:14:13 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:13.817826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:13.818443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:13.825255 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:13.825705 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:13.826481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:13.826918 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:13.857656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-31eb80f8-30fe-4f20-92e3-1fd5a617448a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04" status: 200 len: 194 microversion: 2.1 time: 0.044678 Jul 27 09:14:13.858243 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 426/841] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Jul 27 09:14:13 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:15.183118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45546d2a-13fd-493d-a7c4-d052ac442301"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:15.185475 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:15.199177 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:15.199636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:15.200465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:15.200908 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:15.443581 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0778c333-3838-4e27-8b55-89611848fb32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "POST /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264214 Jul 27 09:14:15.444216 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 416/842] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Jul 27 09:14:15 2022] POST /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:22.966173 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:22.968438 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:22.974894 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:22.975348 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:22.976149 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:22.976591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.158613 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ef070b3f-972e-4623-836c-4921db57cc4a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.196257 Jul 27 09:14:23.159415 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 427/843] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:14:22 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:23.301616 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:23.302388 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:23.309932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.310384 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.311168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.311641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.343544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-441d842e-0a85-458c-b94d-73743baba191 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04" status: 200 len: 194 microversion: 2.1 time: 0.046539 Jul 27 09:14:23.344152 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 417/844] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Jul 27 09:14:23 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:23.355366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:23.355886 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:23.361952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.362392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.363148 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.363579 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.443529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lazy-loading 'services' on Instance uuid aacba783-98be-4165-80de-6e48a7f62151 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:14:23.513715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5f61f0d5-c2b3-457b-8c1f-41f7216fcec0 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04" status: 202 len: 0 microversion: 2.1 time: 0.163182 Jul 27 09:14:23.514302 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 428/845] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:14:23 2022] DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/507acbcc-1921-4094-9429-b97e19f91c04 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:14:23.694373 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:23.696844 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:23.703346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.703830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.704618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.705047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.778201 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-915fd00e-59c1-4137-b7d4-5cb037f08a45 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action" status: 202 len: 0 microversion: 2.1 time: 0.087627 Jul 27 09:14:23.779019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 418/846] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:14:23 2022] POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:14:23.790082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:23.790788 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:23.797076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.797519 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.798286 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:23.798723 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:23.981869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:23.989913 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-07f1a6fb-600a-4f3d-8799-b07f34c82f96 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1752 microversion: 2.1 time: 0.204245 Jul 27 09:14:23.990464 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 429/847] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:23 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:24.636268 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:24.636856 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:24.643071 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:24.643513 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:24.644299 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:24.644726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:24.675371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-68a80935-691b-4e88-8432-d025866e9e2c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/45546d2a-13fd-493d-a7c4-d052ac442301" status: 200 len: 194 microversion: 2.1 time: 0.044927 Jul 27 09:14:24.681609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 419/848] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Jul 27 09:14:24 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/45546d2a-13fd-493d-a7c4-d052ac442301 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:24.687364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:24.687901 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:24.694067 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:24.695117 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:24.696106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:24.696553 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:24.776174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lazy-loading 'services' on Instance uuid aacba783-98be-4165-80de-6e48a7f62151 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:14:24.850639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e09d2e7a-d408-4cde-8dd1-db997772599c tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/45546d2a-13fd-493d-a7c4-d052ac442301" status: 202 len: 0 microversion: 2.1 time: 0.167118 Jul 27 09:14:24.851236 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 430/849] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:14:24 2022] DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments/45546d2a-13fd-493d-a7c4-d052ac442301 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:14:25.013302 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:25.013930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:25.020288 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:25.020741 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:25.021514 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:25.021954 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:25.165372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:25.173474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4519a65b-a4d5-48d7-8fa5-710bf487c165 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.164240 Jul 27 09:14:25.174039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 420/850] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:25 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:26.021168 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:26.024203 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:26.031115 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.031603 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.032408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.032848 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.061255 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-32222613-4277-4f19-902e-0b33f8022735 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044511 Jul 27 09:14:26.061805 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 431/851] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:14:26 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:14:26.177899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:26.180742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:26.187290 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.187780 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.188547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.188987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.196029 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:26.196647 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:26.203020 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.203453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.204290 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.204769 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.218682 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-aa22b7e2-3d46-4733-b0af-d42a176503f9 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044662 Jul 27 09:14:26.219243 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 421/852] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:14:26 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:14:26.282555 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:26.283059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:26.289237 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.289686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.290464 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.290896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.316539 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:14:26.350683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:26.359949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c807b9b4-bea8-464c-a793-b0293eb5c037 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.168598 Jul 27 09:14:26.360723 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 432/853] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:26 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:14:26.394591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-415c1afd-5c01-4a78-8b82-c23d7b92dfa6 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 204 len: 0 microversion: 2.1 time: 0.115592 Jul 27 09:14:26.395308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 422/854] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:14:26 2022] DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 09:14:26.405439 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:26.406036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:26.412100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.412540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.413932 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:26.414362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:26.812694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:26.820595 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d3e939eb-cfef-4d5f-8d03-4b46cbdfec17 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1672 microversion: 2.1 time: 0.419004 Jul 27 09:14:26.821154 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 433/855] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:26 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1672 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:27.382939 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:27.383709 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:27.390710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:27.391433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:27.392168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:27.392641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:27.542149 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:27.550285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0e08952d-6e9c-465b-9bf7-7f7da4b0a6e7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.172445 Jul 27 09:14:27.550851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 423/856] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:27 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:27.841747 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:27.842364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:27.849084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:27.849518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:27.850287 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:27.850722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:27.979731 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:27.987279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9314b1fc-9a9e-421c-8bef-358f012b4840 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1672 microversion: 2.1 time: 0.149467 Jul 27 09:14:27.987864 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 434/857] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:27 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:28.572803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:28.573461 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:28.580355 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:28.580835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:28.581778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:28.582221 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:28.748129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:28.756368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-431937cd-c439-440d-afba-77043be7df8d tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.187670 Jul 27 09:14:28.757039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 424/858] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:28 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:28.980597 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-f6e7e081-3eda-4035-ae9f-02c36cd8759c req-b9c75e19-178d-456c-b8b0-d9f47c6eb9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacba783-98be-4165-80de-6e48a7f62151", "name": "network-vif-deleted", "tag": "0b53e558-b738-49e3-b2bd-209273bc6b9a"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:14:28.993810 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-f6e7e081-3eda-4035-ae9f-02c36cd8759c req-b9c75e19-178d-456c-b8b0-d9f47c6eb9b6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:28.994335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-f6e7e081-3eda-4035-ae9f-02c36cd8759c req-b9c75e19-178d-456c-b8b0-d9f47c6eb9b6 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:29.008404 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-f6e7e081-3eda-4035-ae9f-02c36cd8759c req-b9c75e19-178d-456c-b8b0-d9f47c6eb9b6 service nova] Creating event network-vif-deleted:0b53e558-b738-49e3-b2bd-209273bc6b9a for instance aacba783-98be-4165-80de-6e48a7f62151 on hv-cinder-79760 Jul 27 09:14:29.013840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:29.014809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:29.014984 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-f6e7e081-3eda-4035-ae9f-02c36cd8759c req-b9c75e19-178d-456c-b8b0-d9f47c6eb9b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038017 Jul 27 09:14:29.015510 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 435/859] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:14:29.032465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:29.035787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:29.036660 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:29.037115 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:29.108074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1512e7653d140d9a14d3981a8215969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8f4f43cb3a43a8b67e44df564db90f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:29.116782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9a92cb4b-44bc-49a8-9cde-0c3e749947bd tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 200 len: 1321 microversion: 2.1 time: 0.110894 Jul 27 09:14:29.130613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 425/860] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:29 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 1321 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:14:29.779366 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:29.780563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:29.787085 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:29.787536 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:29.788392 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:29.788837 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:29.946224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:29.954205 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-0dfc8187-ecee-4ca5-b836-03d2a3d02c5a tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.179067 Jul 27 09:14:29.954782 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 436/861] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:29 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:30.140634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:30.141253 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:30.148196 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:30.148649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:30.149424 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:30.149862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:30.153913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:30.164385 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 HTTP/1.1 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:14:30.166042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:30.167800 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'aacba783-98be-4165-80de-6e48a7f62151'} Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:14:30.168834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:30.170686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:30.172202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:14:30.172202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ee239281-ce85-4533-a0be-157fcf90aafe tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 404 len: 111 microversion: 2.1 time: 0.030871 Jul 27 09:14:30.172202 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 426/862] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:30 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:14:30.176893 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7deafde7-fcfd-4898-8999-9910a76f3b41 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '.version_select at 0x7f6f87cabb80>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:30.197512 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7deafde7-fcfd-4898-8999-9910a76f3b41 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424784683" status: 202 len: 0 microversion: 2.1 time: 0.024241 Jul 27 09:14:30.198012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 437/863] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Jul 27 09:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424784683 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 09:14:30.975334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:30.975932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:30.983158 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:30.983606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:30.984412 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:30.984855 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:31.139953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:31.148411 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9f6df3cf-90b9-477d-a2a5-52e586e31c0f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.177384 Jul 27 09:14:31.149002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 427/864] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:30 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:32.170727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:32.171340 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:32.178669 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:32.179133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:32.179971 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:32.180446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:32.327511 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:32.336328 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ee82bcff-5e3d-4a24-b69e-7c729eb28f5b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.170012 Jul 27 09:14:32.336934 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 438/865] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:32 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:33.120417 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:33.120964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:33.127684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.128727 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.129573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.130052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.144713 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 HTTP/1.1 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:14:33.146267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.148416 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'aacba783-98be-4165-80de-6e48a7f62151'} Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:14:33.149327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.150794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.152372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:14:33.152372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-99f29cb5-d870-45f1-8b2c-84ebc5f35f82 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 404 len: 111 microversion: 2.1 time: 0.031724 Jul 27 09:14:33.152372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 428/866] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:14:33 2022] DELETE /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:14:33.156748 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:33.157362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: aacba783-98be-4165-80de-6e48a7f62151] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:33.164078 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.164523 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.165289 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.165730 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.179253 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 HTTP/1.1 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:14:33.180924 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.182475 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'aacba783-98be-4165-80de-6e48a7f62151'} Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:14:33.183364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. Jul 27 09:14:33.184884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:33.186172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance aacba783-98be-4165-80de-6e48a7f62151 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:14:33.186172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ef90df88-0bc5-429e-a657-a2041de52912 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151" status: 404 len: 111 microversion: 2.1 time: 0.029480 Jul 27 09:14:33.186172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 439/867] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:33 2022] GET /compute/v2.1/servers/aacba783-98be-4165-80de-6e48a7f62151 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:14:33.359058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:33.359278 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:33.365076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.365513 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.366900 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:33.367341 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:33.518091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:33.526739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d50243a7-f1e3-41b3-917a-1502d9f26032 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.172132 Jul 27 09:14:33.527296 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 429/868] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:33 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:34.332816 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:34.333380 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:34.340385 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.340868 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.341708 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.342158 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.357218 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 HTTP/1.1 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:14:34.358872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.360929 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'd19c9de0-10fe-40cd-a028-73ab5644fc56'} Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:14:34.361706 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.362936 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.364202 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:14:34.364202 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-46821259-d39e-4180-ba2d-d7152993659a tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 404 len: 111 microversion: 2.1 time: 0.031832 Jul 27 09:14:34.364202 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 440/869] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:14:34 2022] DELETE /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:14:34.370840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:34.371504 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] [instance: d19c9de0-10fe-40cd-a028-73ab5644fc56] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:34.378338 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.378777 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.379545 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.380003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.393960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] HTTP exception thrown: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Request method failure captured: Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 HTTP/1.1 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QD-rFGzV70a0IwgU73nVJ1f-NOTN7zXGc49-63vomeipDpC6AUwXRFKTbQw2RP-ZWNw1UoIpJr3unHgO-8YAkQKkVNh-M3giFI3_EYZCdJrpzv3yxK8piYWWd9BczvcFD4QaZKEVEnc96749TjVFrPjY4r6ivpqIonlCCJCDy7kwX8 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:14:34.395505 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8f4f43cb3a43a8b67e44df564db90f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8f4f43cb3a43a8b67e44df564db90f"}]}] Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 5a8f4f43cb3a43a8b67e44df564db90f Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-138960286 Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: c1512e7653d140d9a14d3981a8215969 Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-AttachVolumeTestJSON-138960286-project Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.397404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'd19c9de0-10fe-40cd-a028-73ab5644fc56'} Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:14:34.398172 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. Jul 27 09:14:34.399483 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:14:34.400852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] Returning 404 to user: Instance d19c9de0-10fe-40cd-a028-73ab5644fc56 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:14:34.400852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0bce9e7e-b078-477b-a38d-c2032cbf2c32 tempest-AttachVolumeTestJSON-138960286 tempest-AttachVolumeTestJSON-138960286-project] 10.222.0.33 "GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56" status: 404 len: 111 microversion: 2.1 time: 0.031645 Jul 27 09:14:34.400852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 430/870] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:34 2022] GET /compute/v2.1/servers/d19c9de0-10fe-40cd-a028-73ab5644fc56 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:14:34.548819 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:34.549528 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:34.556255 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.556641 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.557414 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:34.557849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:34.708834 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:34.717280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7c706494-e856-4d43-956b-52b1e30846d5 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1757 microversion: 2.1 time: 0.172715 Jul 27 09:14:34.717990 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 441/871] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:34 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:14:35.740595 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:14:35.741256 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:14:35.745109 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:35.749968 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:35.750606 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:35.751671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:14:35.752580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:14:36.316571 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:14:36.325396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2aa9dbfe-1aa8-4ec7-adb1-27b2a6eaa2ee tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1760 microversion: 2.1 time: 0.588733 Jul 27 09:14:36.326106 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 431/872] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:14:35 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1760 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:10.119086 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1450148276"}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:10.119697 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:10.122006 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:10.122658 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:10.129488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:10.129934 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:10.130692 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:10.131116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:10.443227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.network.security_group_api [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Removing security group 134926b2-5dfe-4755-834c-9d0f8fc9bdbb from port 75b9880c-6980-41f1-93af-64ea0b224e08 Jul 27 09:15:10.792573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6ff01913-e849-4ae1-9283-d5a427e95359 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action" status: 202 len: 0 microversion: 2.1 time: 0.677987 Jul 27 09:15:10.796465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 442/873] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:15:10 2022] POST /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:15:10.815316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:10.816492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=23 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:10.821690 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-2b25cc52-04bd-40dc-a865-0d52fb3eaab6 req-5c42723d-dd61-4fa9-bba2-eea7a11e9dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:10.830613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2b25cc52-04bd-40dc-a865-0d52fb3eaab6 req-5c42723d-dd61-4fa9-bba2-eea7a11e9dd2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:10.831396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-2b25cc52-04bd-40dc-a865-0d52fb3eaab6 req-5c42723d-dd61-4fa9-bba2-eea7a11e9dd2 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:10.851775 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-2b25cc52-04bd-40dc-a865-0d52fb3eaab6 req-5c42723d-dd61-4fa9-bba2-eea7a11e9dd2 service nova] Creating event network-changed:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:15:10.857710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-2b25cc52-04bd-40dc-a865-0d52fb3eaab6 req-5c42723d-dd61-4fa9-bba2-eea7a11e9dd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043584 Jul 27 09:15:10.858567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 432/874] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:11.954673 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:11.955264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:11.958981 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-8ccb41fc-29ca-4fd5-8ba9-9403c2af4de7 req-7dba69e8-da4a-405c-820f-6b763dbb2078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:11.962398 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:11.962860 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:11.963790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:11.964488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:11.999076 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-8ccb41fc-29ca-4fd5-8ba9-9403c2af4de7 req-7dba69e8-da4a-405c-820f-6b763dbb2078 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:11.999423 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-8ccb41fc-29ca-4fd5-8ba9-9403c2af4de7 req-7dba69e8-da4a-405c-820f-6b763dbb2078 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:12.025865 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-8ccb41fc-29ca-4fd5-8ba9-9403c2af4de7 req-7dba69e8-da4a-405c-820f-6b763dbb2078 service nova] Creating event network-changed:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:15:12.039471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-8ccb41fc-29ca-4fd5-8ba9-9403c2af4de7 req-7dba69e8-da4a-405c-820f-6b763dbb2078 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091106 Jul 27 09:15:12.065085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 433/875] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:12.156466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lazy-loading 'services' on Instance uuid 8e9fbfcf-a74e-4583-9abd-f25f036f9059 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:15:12.281291 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bacf4c53-4b4e-4893-8e41-d73be5c63ae7 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments/c8fb8317-eac1-4cda-bef3-32598d7cec46" status: 202 len: 0 microversion: 2.1 time: 0.334606 Jul 27 09:15:12.282465 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 443/876] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:15:11 2022] DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments/c8fb8317-eac1-4cda-bef3-32598d7cec46 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:15:12.292782 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:12.295588 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:12.302499 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:12.303220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:12.304229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:12.304662 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:12.341601 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-43916758-31e7-4f55-b1ad-a0bc521501d9 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053175 Jul 27 09:15:12.342421 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 434/877] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:15:12 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:13.011561 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:13.012364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:13.019722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.021031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.021839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.022285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.047135 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lazy-loading 'flavor' on Instance uuid dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:15:13.128355 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-02415ed1-e82e-4ca9-93c3-49113f3ba656 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action" status: 202 len: 0 microversion: 2.1 time: 0.121745 Jul 27 09:15:13.130018 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 444/878] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:15:13 2022] POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:15:13.137460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:13.138077 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:13.144267 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.144711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.146108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.146566 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.341429 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:13.349712 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-50723b3f-ad92-4444-800f-8c099e434d29 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.215929 Jul 27 09:15:13.361614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 435/879] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:13 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:13.361884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:13.361884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:13.365683 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.366145 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.366937 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:13.367381 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:13.400095 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bfc5b947-e0f7-4bd8-8d4c-a409c0a29812 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048739 Jul 27 09:15:13.400681 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 445/880] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:15:13 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:15:14.373637 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:14.374242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:14.381455 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:14.381902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:14.382930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:14.383357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:14.412322 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:14.414665 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:14.421316 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:14.421766 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:14.422548 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:14.422989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:14.455144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9e7b4cf5-4925-4bb6-8032-8fe69010715b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Jul 27 09:15:14.455738 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 446/881] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:15:14 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:15:14.520432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:14.528058 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a48553d5-f4ad-4480-9ee5-b15a71eef81d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.158211 Jul 27 09:15:14.528634 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 436/882] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:14 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:15.468082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:15.470288 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:15.477356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:15.477811 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:15.478593 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:15.479032 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:15.510497 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-af94530e-3f97-4afd-b065-00266b093a57 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046557 Jul 27 09:15:15.511066 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 447/883] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:15:15 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:15.550206 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:15.550971 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:15.557599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:15.558044 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:15.558809 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:15.559239 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:15.696085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:15.703795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-5906be1a-0fdd-42bc-8e42-6dbd70ec03f1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.157569 Jul 27 09:15:15.704357 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 437/884] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:15 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:16.524280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:16.526443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:16.533224 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.533548 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.534329 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.534812 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.564114 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4a748af0-1fea-4d25-860b-ac26c44e0a23 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045354 Jul 27 09:15:16.564715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 448/885] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Jul 27 09:15:16 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:15:16.576591 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:16.577136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:16.583720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.584237 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.585026 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.585440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.665949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] HTTP exception thrown: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 is not attached to volume c8fb8317-eac1-4cda-bef3-32598d7cec46 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Request method failure captured: Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments/c8fb8317-eac1-4cda-bef3-32598d7cec46 HTTP/1.1 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QGpdgCFk7eKtzVWIA4SDybxDakKgu1-jkJz03kADAfGOi9sRtShBIZmAC9H23cTvzobaBOeI6rm7_Dh6cc62xCAKnpbhjBtB-4jp12jEpcTfSxWnP0c-CwU3TO1qN4HD_oD3tFBSB6Lgswd2wsfirg0iDEUGclvZ4-t59m5_xjoLUU Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 194387beb32449da80a42f5c2e66aa12 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:15:16.668472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_194387beb32449da80a42f5c2e66aa12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/194387beb32449da80a42f5c2e66aa12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/194387beb32449da80a42f5c2e66aa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/194387beb32449da80a42f5c2e66aa12"}]}] Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 194387beb32449da80a42f5c2e66aa12 Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-TestMinimumBasicScenario-484296211-project Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: cddaad3615f041b59a87547386049309 Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-TestMinimumBasicScenario-484296211-project Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:15:16.670234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 is not attached to volume c8fb8317-eac1-4cda-bef3-32598d7cec46 Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'server_id': '8e9fbfcf-a74e-4583-9abd-f25f036f9059', 'id': 'c8fb8317-eac1-4cda-bef3-32598d7cec46'} Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c8fb8317-eac1-4cda-bef3-32598d7cec46. Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:15:16.671081 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 is not attached to volume c8fb8317-eac1-4cda-bef3-32598d7cec46 Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 is not attached to volume c8fb8317-eac1-4cda-bef3-32598d7cec46 Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:15:16.672466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Returning 404 to user: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 is not attached to volume c8fb8317-eac1-4cda-bef3-32598d7cec46 {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:15:16.673473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-80eab0ce-cace-4745-99d7-b85a8bcd669b tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments/c8fb8317-eac1-4cda-bef3-32598d7cec46" status: 404 len: 154 microversion: 2.1 time: 0.097473 Jul 27 09:15:16.673473 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 438/886] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Jul 27 09:15:16 2022] DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059/os-volume_attachments/c8fb8317-eac1-4cda-bef3-32598d7cec46 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 09:15:16.726123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:16.726943 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:16.733721 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.734264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.735050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:16.735494 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:16.870467 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:16.878849 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5a0ab918-ea67-4dff-9cda-bd60ee282166 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.157615 Jul 27 09:15:16.879458 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 449/887] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:16 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:17.809486 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:17.810059 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:17.817633 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.818086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:17.818862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.819297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:17.844404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:15:17.907001 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:17.907622 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:17.921024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.921227 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cb8d857c-c2b8-4a63-84da-dbfc44b3a885 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 204 len: 0 microversion: 2.1 time: 0.115317 Jul 27 09:15:17.922014 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:17.923075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.923607 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:17.927838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 439/888] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:15:17 2022] DELETE /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:15:17.934310 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:17.935011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:17.941061 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.941506 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:17.942821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:17.943293 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:18.063489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:18.071635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-57a8298e-c60f-4eb2-a438-32847e6ef2b5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.168424 Jul 27 09:15:18.072244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 450/889] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:17 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:18.086877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:18.094355 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0b6a7f3e-4b90-4753-b9e8-002c117fdef1 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1554 microversion: 2.1 time: 0.164993 Jul 27 09:15:18.094916 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 440/890] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:17 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:19.093546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:19.094576 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:19.102986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:19.103548 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:19.104476 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:19.105025 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:19.117946 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:19.119054 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:19.129573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:19.130603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:19.131899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:19.132749 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:19.260371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:19.268062 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-77d38c12-624a-4f5d-8ae6-ad29861276d8 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.179962 Jul 27 09:15:19.268648 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 451/891] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:19 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:19.275023 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:19.282745 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b932ca41-ae3a-41ff-84d9-95d346df9d3e tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1554 microversion: 2.1 time: 0.170700 Jul 27 09:15:19.283304 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 441/892] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:19 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:20.289133 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:20.289742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:20.296481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:20.296927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:20.297693 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:20.298130 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:20.304922 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:20.305543 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:20.312013 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:20.312465 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:20.313245 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:20.313686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:20.434774 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:20.442484 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e92f6d40-085a-40ac-b892-1ffb7691b2d6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.157109 Jul 27 09:15:20.443474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 452/893] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:20 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:20.450656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:20.458752 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ee32c2be-5411-4131-a604-10423630b188 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1554 microversion: 2.1 time: 0.158262 Jul 27 09:15:20.459389 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 442/894] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:20 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:21.468760 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:21.469304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:21.476498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:21.476977 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:21.477751 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:21.478184 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:21.480631 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:21.481359 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:21.488088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:21.488594 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:21.489371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:21.489806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:21.616225 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:21.621562 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:21.624241 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-5a92bb2d-1b79-4940-aa94-c8ed5974e56c tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.159610 Jul 27 09:15:21.625046 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 453/895] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:21 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:21.630181 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-da13cb9b-e1d4-4b72-86d0-e863abb2a557 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1554 microversion: 2.1 time: 0.153672 Jul 27 09:15:21.630831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 443/896] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:21 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:22.522813 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-01b1c74b-b490-4260-beb5-7993b68f98b1 req-c7c56ac6-50a0-413d-868e-803150dc7e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9fbfcf-a74e-4583-9abd-f25f036f9059", "name": "network-vif-deleted", "tag": "75b9880c-6980-41f1-93af-64ea0b224e08"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:22.533565 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-01b1c74b-b490-4260-beb5-7993b68f98b1 req-c7c56ac6-50a0-413d-868e-803150dc7e77 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.533775 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-01b1c74b-b490-4260-beb5-7993b68f98b1 req-c7c56ac6-50a0-413d-868e-803150dc7e77 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.545914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-01b1c74b-b490-4260-beb5-7993b68f98b1 req-c7c56ac6-50a0-413d-868e-803150dc7e77 service nova] Creating event network-vif-deleted:75b9880c-6980-41f1-93af-64ea0b224e08 for instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 on hv-cinder-79760 Jul 27 09:15:22.553361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-01b1c74b-b490-4260-beb5-7993b68f98b1 req-c7c56ac6-50a0-413d-868e-803150dc7e77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Jul 27 09:15:22.553992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 454/897] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:22.646618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:22.647223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:22.652359 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:22.653112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:22.654529 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.655297 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.656175 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.656699 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.659339 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.659815 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.660581 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.661019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.694323 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:22.694821 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:22.695279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lazy-loading 'fault' on Instance uuid 8e9fbfcf-a74e-4583-9abd-f25f036f9059 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:15:22.741446 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddaad3615f041b59a87547386049309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '194387beb32449da80a42f5c2e66aa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:22.750031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-45d196c3-ed0c-4168-b0cf-2637d3683c05 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 200 len: 1348 microversion: 2.1 time: 0.102220 Jul 27 09:15:22.750618 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 455/898] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:22 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:22.794788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:22.803027 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-8746b419-f3c6-4b76-be7d-62d69a31b76d tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.161028 Jul 27 09:15:22.803716 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 444/899] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:22 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:23.772988 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:23.773555 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] [instance: 8e9fbfcf-a74e-4583-9abd-f25f036f9059] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:23.780155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:23.780602 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:23.781374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:23.781813 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:23.795973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] HTTP exception thrown: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Request method failure captured: Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 HTTP/1.1 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QGpdgCFk7eKtzVWIA4SDybxDakKgu1-jkJz03kADAfGOi9sRtShBIZmAC9H23cTvzobaBOeI6rm7_Dh6cc62xCAKnpbhjBtB-4jp12jEpcTfSxWnP0c-CwU3TO1qN4HD_oD3tFBSB6Lgswd2wsfirg0iDEUGclvZ4-t59m5_xjoLUU Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 194387beb32449da80a42f5c2e66aa12 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:15:23.797674 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_194387beb32449da80a42f5c2e66aa12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/194387beb32449da80a42f5c2e66aa12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/194387beb32449da80a42f5c2e66aa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/194387beb32449da80a42f5c2e66aa12"}]}] Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 194387beb32449da80a42f5c2e66aa12 Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-TestMinimumBasicScenario-484296211 Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-TestMinimumBasicScenario-484296211-project Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: cddaad3615f041b59a87547386049309 Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-TestMinimumBasicScenario-484296211-project Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. Jul 27 09:15:23.799261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': '8e9fbfcf-a74e-4583-9abd-f25f036f9059'} Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:15:23.800178 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. Jul 27 09:15:23.802317 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:15:23.803657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Returning 404 to user: Instance 8e9fbfcf-a74e-4583-9abd-f25f036f9059 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:15:23.803657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-cb6fb86b-b2dd-470c-bfff-b6db75abc1a4 tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059" status: 404 len: 111 microversion: 2.1 time: 0.030772 Jul 27 09:15:23.803657 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 456/900] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:23 2022] GET /compute/v2.1/servers/8e9fbfcf-a74e-4583-9abd-f25f036f9059 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:15:23.808811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-56549d3f-1d4c-4e0c-9554-9c2bbd581b9f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] Calling method '.version_select at 0x7f6f9458a160>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:23.823827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:23.824635 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:23.828730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-56549d3f-1d4c-4e0c-9554-9c2bbd581b9f tempest-TestMinimumBasicScenario-484296211 tempest-TestMinimumBasicScenario-484296211-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2005941094" status: 202 len: 0 microversion: 2.1 time: 0.023780 Jul 27 09:15:23.829640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 445/901] 10.222.0.33 () {58 vars in 1272 bytes} [Wed Jul 27 09:15:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2005941094 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:15:23.831105 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:23.831558 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:23.832365 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:23.832811 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:23.837220 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:23.970934 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:23.979955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a8b46e7f-3ee7-47b7-af5a-36772d5dd73b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.160044 Jul 27 09:15:23.980521 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 457/902] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:23 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:25.000910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:25.001609 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:25.010145 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:25.010862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:25.011372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:25.011846 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:25.230124 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:25.238415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ddceb441-3cca-4ecd-8fda-8192cd5ec497 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.241525 Jul 27 09:15:25.239806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 446/903] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:24 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:26.262031 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:26.262931 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:26.269961 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:26.270442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:26.271284 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:26.271824 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:26.410646 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:26.420081 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d3c729ad-3335-4e83-91a7-15c8389c59b4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.162464 Jul 27 09:15:26.420656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 458/904] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:26 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:27.442565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:27.443119 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:27.449728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:27.450186 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:27.450970 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:27.451400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:27.673650 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:27.683371 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-53cac7ae-bb46-4b1b-8dba-d33d90fc0af7 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.244900 Jul 27 09:15:27.684016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 447/905] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:27 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:28.708720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:28.709334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:28.716111 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:28.716559 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:28.717329 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:28.718004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:28.933121 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:28.941022 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b5f06072-068e-41bd-bf10-c5cdc9537bda tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.236638 Jul 27 09:15:28.949670 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 459/906] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:28 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:29.963127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:29.964766 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:29.981155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:29.981703 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:29.983090 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:29.984014 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:30.128731 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:30.136846 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3e924000-84fb-415a-8545-704862c50993 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.177859 Jul 27 09:15:30.137652 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 448/907] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:29 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:31.165417 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:31.166293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:31.182406 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:31.182898 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:31.184602 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:31.185216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:31.369733 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:31.378788 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-520a71d5-1455-4f3a-a2e9-fdf7dc93455b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.223267 Jul 27 09:15:31.380258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 460/908] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:31 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:32.403698 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:32.404350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:32.411870 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:32.412602 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:32.413392 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:32.413998 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:32.419947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:32.577457 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:32.586178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b78ed331-f11d-4e7c-9191-10e6ec5586ef tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.186096 Jul 27 09:15:32.586776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 449/909] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:32 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:33.608197 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:33.609420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:33.616807 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:33.617261 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:33.618048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:33.618515 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:33.781104 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:33.791927 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6f5b4bee-2d4e-4d19-927e-f4601c62c320 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1507 microversion: 2.1 time: 0.187371 Jul 27 09:15:33.793087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 461/910] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:33 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:33.816285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:33.818444 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:33.834889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:33.835729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:33.836877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:33.838452 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:34.119858 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d2759c36-87c1-4676-86b4-6ea582e9ebba tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action" status: 202 len: 0 microversion: 2.1 time: 0.307787 Jul 27 09:15:34.120684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 450/911] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:15:33 2022] POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:15:34.130489 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:34.131599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:34.143610 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:34.144871 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:34.146264 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:34.146854 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:34.389335 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:34.400481 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8a50203e-12b2-4878-9d48-6005f349795e tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1515 microversion: 2.1 time: 0.274426 Jul 27 09:15:34.406959 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 462/912] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:34 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:35.428280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:35.428953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:35.448197 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:35.461656 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:35.466436 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:35.496596 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:35.740603 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:35.751285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2537d4f7-d537-4003-9f2c-e940d78cca09 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1517 microversion: 2.1 time: 0.332494 Jul 27 09:15:35.751921 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 451/913] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:35 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1517 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:36.354119 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-794424ac-d30e-4267-9a6f-a085db2d1d7f req-b69b18d5-61d8-41fe-beac-4e66f73b0535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:36.365724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-794424ac-d30e-4267-9a6f-a085db2d1d7f req-b69b18d5-61d8-41fe-beac-4e66f73b0535 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:36.366082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-794424ac-d30e-4267-9a6f-a085db2d1d7f req-b69b18d5-61d8-41fe-beac-4e66f73b0535 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:36.388244 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-794424ac-d30e-4267-9a6f-a085db2d1d7f req-b69b18d5-61d8-41fe-beac-4e66f73b0535 service nova] Creating event network-vif-unplugged:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:15:36.396894 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-794424ac-d30e-4267-9a6f-a085db2d1d7f req-b69b18d5-61d8-41fe-beac-4e66f73b0535 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.217854 Jul 27 09:15:36.398694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 463/914] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:36.777712 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:36.779108 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:36.787387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:36.788214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:36.789218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:36.789954 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:37.030168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:37.046259 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-7f1567fd-00ac-4de5-9c24-130dae926f26 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.274810 Jul 27 09:15:37.047177 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 452/915] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:36 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:15:38.068546 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:38.070340 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:38.077578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:38.078127 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:38.078954 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:38.079492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:38.241440 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:38.249690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b5e15326-0f66-4be0-af72-c85152f7f341 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.186174 Jul 27 09:15:38.250483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 464/916] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:38 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:39.273458 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:39.274151 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:39.281127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:39.281580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:39.282364 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:39.282799 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:39.429131 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:39.448806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-120242cb-ccac-4ce2-9df7-5c97b36104b6 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.179899 Jul 27 09:15:39.449687 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 453/917] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:39 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:40.471681 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:40.472418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:40.483808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=49 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:40.486019 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:40.486695 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:40.487865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:40.488551 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:40.741839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:40.755229 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c3bc0e8d-f062-4830-a0c6-06dc883f2de3 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.288366 Jul 27 09:15:40.755853 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 465/918] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:40 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:41.779029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:41.780436 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:41.783862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:41.792395 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:41.792942 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:41.793828 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:41.795040 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:42.038318 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:42.048751 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-735dcc57-ee61-41ba-9a47-c12746d57d36 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.274600 Jul 27 09:15:42.049351 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 454/919] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:41 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:43.072216 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:43.076069 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:43.104386 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:43.106073 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:43.107196 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:43.108561 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:43.421058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:43.433947 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-96ff2d02-4c83-4105-90bf-e697e2d007c9 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.363442 Jul 27 09:15:43.434866 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 466/920] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:43 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:44.464131 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:44.465349 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:44.476605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:44.477396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:44.485213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:44.488300 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:44.719229 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:44.749794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6f7ab782-61dd-41e4-9f2b-5d20409c2f17 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.295265 Jul 27 09:15:44.750755 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 455/921] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:44 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:45.344642 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-37367744-cdb0-4a60-a58b-2530268f324d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Action: 'create', calling method: .version_select at 0x7f6f87c8aca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-115497172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2234BweNAGs+L5YFuTnUMajU/03ID+J/XRNsSbowEl+cT7TSmFFPAY9G75la5zdHeWxzMzUEXTH1H5zNJMs8vFcQEuBBlrD/qMXZa8mxdw7I54PlMDE8CZIOiwusDlnA=="}} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:45.360985 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-37367744-cdb0-4a60-a58b-2530268f324d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:15:45.365806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.quota [None req-37367744-cdb0-4a60-a58b-2530268f324d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for user f2fca61ad18948d0b24ca1a1a10ddfe4 and project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'key_pairs'} {{(pid=117923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:15:45.393353 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-37367744-cdb0-4a60-a58b-2530268f324d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.280172 Jul 27 09:15:45.393953 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 467/922] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Jul 27 09:15:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:45.772873 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:45.773498 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:45.780515 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:45.781014 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:45.781805 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:45.782440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:45.931526 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:45.944365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9cb39bd5-c034-4937-aa4b-c2e07b216d0b tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.175333 Jul 27 09:15:45.945563 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 456/923] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:45 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:46.494036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-e96bfe93-dd7c-4fc2-a957-9e6f5b23854e req-42024111-76b7-4891-97fe-b099fd5b714b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "name": "network-vif-plugged", "status": "completed", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:15:46.510992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-e96bfe93-dd7c-4fc2-a957-9e6f5b23854e req-42024111-76b7-4891-97fe-b099fd5b714b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:46.511345 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-e96bfe93-dd7c-4fc2-a957-9e6f5b23854e req-42024111-76b7-4891-97fe-b099fd5b714b service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:46.524374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-e96bfe93-dd7c-4fc2-a957-9e6f5b23854e req-42024111-76b7-4891-97fe-b099fd5b714b service nova] Creating event network-vif-plugged:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:15:46.529919 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-e96bfe93-dd7c-4fc2-a957-9e6f5b23854e req-42024111-76b7-4891-97fe-b099fd5b714b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044083 Jul 27 09:15:46.530879 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 468/924] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:15:46.971724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:46.972484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:46.984084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:46.984834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:46.986061 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:46.986657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:47.146559 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:47.156275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-f1c305a8-b455-4607-8425-e75d529c6155 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1573 microversion: 2.1 time: 0.189655 Jul 27 09:15:47.157127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 457/925] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:46 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:15:48.182563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:15:48.183497 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:15:48.192836 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:48.193632 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:48.194716 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:15:48.195470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:15:48.354597 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:15:48.362722 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-11845ae4-6a1f-407b-91c0-0deccccf5845 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1560 microversion: 2.1 time: 0.187236 Jul 27 09:15:48.371989 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 469/926] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:15:48 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:00.974234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-391046988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-115497172", "security_groups": [{"name": "tempest-secgroup-smoke-1044509761"}], "block_device_mapping_v2": [{"uuid": "6f3bbb14-f9f7-48e2-aeae-ac6852438ae9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50a61881-b9b5-4c5d-9158-d7367ce8da5f"}]}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:16:00.985047 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=7 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:00.985720 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:01.114751 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] validate_networks() for [('50a61881-b9b5-4c5d-9158-d7367ce8da5f', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:16:01.531034 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:16:01.531570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:16:01.532134 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:16:01.532654 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:16:01.533084 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:16:01.543322 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:01.543790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:01.544580 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:01.545006 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:01.563168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:16:01.567638 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for user f2fca61ad18948d0b24ca1a1a10ddfe4 and project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:16:01.628975 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:16:01.631737 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f3bbb14-f9f7-48e2-aeae-ac6852438ae9',volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:16:01.775927 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ca153574-dc3d-45a2-b1fd-092803e1cb3e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806175 Jul 27 09:16:01.776567 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 458/927] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:16:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:16:01.788273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c37f9f4f-38a8-43c4-8d3f-1f80acb4d3cb tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:01.789044 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c37f9f4f-38a8-43c4-8d3f-1f80acb4d3cb tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:01.792572 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:01.792889 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:01.793474 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=62 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:01.854598 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c37f9f4f-38a8-43c4-8d3f-1f80acb4d3cb tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:01.861478 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c37f9f4f-38a8-43c4-8d3f-1f80acb4d3cb tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1093 microversion: 2.1 time: 0.077939 Jul 27 09:16:01.862039 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 470/928] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:01 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:16:02.883895 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e69139d3-f238-4f62-b187-97f1192dfa23 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:02.884716 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e69139d3-f238-4f62-b187-97f1192dfa23 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:02.937246 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e69139d3-f238-4f62-b187-97f1192dfa23 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:02.943891 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e69139d3-f238-4f62-b187-97f1192dfa23 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1093 microversion: 2.1 time: 0.064983 Jul 27 09:16:02.944456 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 459/929] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:02 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:03.964827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2620905b-c869-49d2-9861-269d2bb36e47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:03.965453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2620905b-c869-49d2-9861-269d2bb36e47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:04.024678 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2620905b-c869-49d2-9861-269d2bb36e47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:04.032656 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2620905b-c869-49d2-9861-269d2bb36e47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1093 microversion: 2.1 time: 0.071759 Jul 27 09:16:04.033240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 471/930] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:03 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:05.053408 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-53df8cb1-14e3-46ae-8e76-ed68297b1fa4 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:05.054028 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-53df8cb1-14e3-46ae-8e76-ed68297b1fa4 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:05.117180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-53df8cb1-14e3-46ae-8e76-ed68297b1fa4 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:05.123967 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-53df8cb1-14e3-46ae-8e76-ed68297b1fa4 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1093 microversion: 2.1 time: 0.074473 Jul 27 09:16:05.124547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 460/931] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:05 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:06.147123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:06.147741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:06.153910 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:06.154362 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:06.155172 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:06.155651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:06.216529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:06.224839 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-58d3f901-5294-4122-8696-304043981644 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1143 microversion: 2.1 time: 0.081717 Jul 27 09:16:06.225410 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 472/932] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:06 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:07.245610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:07.246162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:07.253700 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:07.254274 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:07.255130 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:07.255641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:07.329674 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:07.337819 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-d1feafe3-62d0-446d-ba63-369996b1ceb9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1209 microversion: 2.1 time: 0.096298 Jul 27 09:16:07.338718 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 461/933] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:07 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:08.303969 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-815385f1-6fd7-4e96-9344-29d06e5f358f req-744d0e74-0c45-4100-ae75-4ba9fadbad72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48566c0-5113-4e79-a7bb-6c464828c590", "tag": "0d989c40-7440-40cf-9438-893800011847"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:16:08.315599 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-815385f1-6fd7-4e96-9344-29d06e5f358f req-744d0e74-0c45-4100-ae75-4ba9fadbad72 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:08.316087 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-815385f1-6fd7-4e96-9344-29d06e5f358f req-744d0e74-0c45-4100-ae75-4ba9fadbad72 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:08.330497 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-815385f1-6fd7-4e96-9344-29d06e5f358f req-744d0e74-0c45-4100-ae75-4ba9fadbad72 service nova] Creating event network-changed:0d989c40-7440-40cf-9438-893800011847 for instance f48566c0-5113-4e79-a7bb-6c464828c590 on hv-cinder-79760 Jul 27 09:16:08.337732 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-815385f1-6fd7-4e96-9344-29d06e5f358f req-744d0e74-0c45-4100-ae75-4ba9fadbad72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189857 Jul 27 09:16:08.338234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 473/934] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:16:08.360096 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:08.360795 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:08.367512 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:08.368056 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:08.368892 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:08.369407 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:08.499441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:08.507565 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-0cc9d9ba-58d1-4c8e-8cc6-bb1607d038af tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.151488 Jul 27 09:16:08.508160 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 462/935] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:08 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:09.529088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:09.529806 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:09.536541 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:09.536987 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:09.537754 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:09.538187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:09.681889 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:09.689713 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-d9193763-e659-45fd-9178-22d10ee831fe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.164794 Jul 27 09:16:09.690235 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 474/936] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:09 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:10.711046 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:10.711669 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:10.718181 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:10.718632 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:10.719402 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:10.719872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:10.852808 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:10.860400 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-70d74629-bdd7-4b78-980f-b87449b6d5bd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.153808 Jul 27 09:16:10.860973 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 463/937] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:10 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:11.882141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:11.882748 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:11.889559 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:11.889998 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:11.890756 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:11.891186 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:12.023768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:12.031356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-94e494f2-7655-4148-b610-fb7557b74693 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.153610 Jul 27 09:16:12.031957 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 475/938] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:11 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:13.053493 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:13.054080 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:13.056009 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:13.061492 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:13.061930 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:13.062689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:13.063117 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:13.198960 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:13.206767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-e266bed0-a597-427a-a81d-1601562fc631 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.158041 Jul 27 09:16:13.207948 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 464/939] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:13 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:14.228562 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:14.229177 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:14.231865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:14.237528 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:14.237973 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:14.238749 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:14.239187 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:14.372767 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:14.380850 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ff037db3-f466-4c03-925f-390653804b06 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.156157 Jul 27 09:16:14.381425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 476/940] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:14 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:15.401729 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:15.402284 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:15.404619 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=10 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:15.410866 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:15.411368 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:15.412129 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:15.412574 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:15.544956 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:15.553994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-626bd6bf-784a-447c-9fa7-5b7ed1e3adee tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.156314 Jul 27 09:16:15.554728 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 465/941] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:15 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:16.574663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:16.575300 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:16.582048 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:16.582497 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:16.583272 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:16.583711 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:16.722784 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:16.740825 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a1477613-24a4-4d71-af19-585749ebbe0b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.170025 Jul 27 09:16:16.741636 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 477/942] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:16 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:17.761547 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:17.762082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:17.768739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:17.769183 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:17.770678 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:17.771113 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:17.903350 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:17.910778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6b1355a8-9e24-4eec-bfb6-c7895eeb4673 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.153552 Jul 27 09:16:17.911332 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 466/943] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:17 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:18.418057 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-ff342100-f776-452a-93d2-2aa7349c9290 req-56b47315-b571-4b41-8cb0-ab24328337a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48566c0-5113-4e79-a7bb-6c464828c590", "name": "network-vif-plugged", "status": "completed", "tag": "0d989c40-7440-40cf-9438-893800011847"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:16:18.429194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ff342100-f776-452a-93d2-2aa7349c9290 req-56b47315-b571-4b41-8cb0-ab24328337a7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:18.429639 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-ff342100-f776-452a-93d2-2aa7349c9290 req-56b47315-b571-4b41-8cb0-ab24328337a7 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:18.440911 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-ff342100-f776-452a-93d2-2aa7349c9290 req-56b47315-b571-4b41-8cb0-ab24328337a7 service nova] Creating event network-vif-plugged:0d989c40-7440-40cf-9438-893800011847 for instance f48566c0-5113-4e79-a7bb-6c464828c590 on hv-cinder-79760 Jul 27 09:16:18.445865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-ff342100-f776-452a-93d2-2aa7349c9290 req-56b47315-b571-4b41-8cb0-ab24328337a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031484 Jul 27 09:16:18.446454 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 478/944] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:16:18.931145 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:18.931741 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:18.938234 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:18.938679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:18.939441 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:18.939898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:19.070878 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:19.078474 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-389e0489-3535-4efa-9a12-849eac587fff tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1265 microversion: 2.1 time: 0.151193 Jul 27 09:16:19.079050 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 467/945] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:18 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:20.102443 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:20.103167 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:20.110252 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:20.110770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:20.111642 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:20.112109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:20.242865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:20.250664 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6e80d27e-df61-44f8-a626-c057ad8b8856 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1453 microversion: 2.1 time: 0.154561 Jul 27 09:16:20.251304 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 479/946] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:20 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:20.272475 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:16:20.273112 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:16:20.279524 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:20.280002 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:20.280760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:20.281200 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:20.417370 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:16:20.424833 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b3f6646c-2e2d-45dd-a63c-74ec1b0977ec tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1453 microversion: 2.1 time: 0.156204 Jul 27 09:16:20.425404 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 468/947] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:16:20 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:16:22.173502 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-730b590e-4f29-460b-b6a9-4ae3a3377da4 req-d78ad191-f5af-4a50-8b8c-ae0247bfa858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48566c0-5113-4e79-a7bb-6c464828c590", "tag": "0d989c40-7440-40cf-9438-893800011847"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:16:22.183014 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-730b590e-4f29-460b-b6a9-4ae3a3377da4 req-d78ad191-f5af-4a50-8b8c-ae0247bfa858 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:16:22.183452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-730b590e-4f29-460b-b6a9-4ae3a3377da4 req-d78ad191-f5af-4a50-8b8c-ae0247bfa858 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:16:22.194854 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-730b590e-4f29-460b-b6a9-4ae3a3377da4 req-d78ad191-f5af-4a50-8b8c-ae0247bfa858 service nova] Creating event network-changed:0d989c40-7440-40cf-9438-893800011847 for instance f48566c0-5113-4e79-a7bb-6c464828c590 on hv-cinder-79760 Jul 27 09:16:22.199666 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-730b590e-4f29-460b-b6a9-4ae3a3377da4 req-d78ad191-f5af-4a50-8b8c-ae0247bfa858 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Jul 27 09:16:22.200480 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 480/948] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:16:44.720227 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:16:44.720868 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:16:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:18:17.122520 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:18:17.123314 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:18:17.275180 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:17.275968 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=50 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:17.279913 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:17.280377 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:17.288376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:17.288834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:17.289610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:17.290044 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:17.318640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Going to try to terminate instance {{(pid=117922) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:18:17.393860 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-acb1a641-b73a-44d1-928c-cdfeffa73339 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 204 len: 0 microversion: 2.1 time: 0.120199 Jul 27 09:18:17.394520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 469/949] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:18:17 2022] DELETE /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:18:17.401701 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5908cf7d-e70a-45de-9cfe-1ccc675de398] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 27 09:18:17.402356 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=26 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:17.403109 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=42 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:17.407454 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:17.408795 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:17.416342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:17.416790 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:17.417562 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:17.417999 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:17.549492 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:17.557700 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3248acfd-d4bc-4cbd-96ce-dd369db0ebcd tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1578 microversion: 2.1 time: 0.157945 Jul 27 09:18:17.558300 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 481/950] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:17 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:18:18.586103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:18.586821 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:18.593365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:18.593811 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:18.594570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:18.595005 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:18.732106 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:18.739854 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-30fa6295-0b65-4297-8523-aa88cda3c0cf tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1578 microversion: 2.1 time: 0.157954 Jul 27 09:18:18.740432 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 470/951] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:18 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:19.747858 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-fa7d59a0-0f8f-4f78-9ea1-83997c398b01 req-f251b0b4-f9a8-4b98-9f4f-4731571c3ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48566c0-5113-4e79-a7bb-6c464828c590", "name": "network-vif-deleted", "tag": "0d989c40-7440-40cf-9438-893800011847"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:18:19.763080 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:19.764376 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:19.771995 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:19.772674 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:19.773722 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:19.774317 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:19.780308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] [5908cf7d-e70a-45de-9cfe-1ccc675de398] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57192. Jul 27 09:18:19.783034 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fa7d59a0-0f8f-4f78-9ea1-83997c398b01 req-f251b0b4-f9a8-4b98-9f4f-4731571c3ac3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:19.783250 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-fa7d59a0-0f8f-4f78-9ea1-83997c398b01 req-f251b0b4-f9a8-4b98-9f4f-4731571c3ac3 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:19.798071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-fa7d59a0-0f8f-4f78-9ea1-83997c398b01 req-f251b0b4-f9a8-4b98-9f4f-4731571c3ac3 service nova] Creating event network-vif-deleted:0d989c40-7440-40cf-9438-893800011847 for instance f48566c0-5113-4e79-a7bb-6c464828c590 on hv-cinder-79760 Jul 27 09:18:19.804273 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-fa7d59a0-0f8f-4f78-9ea1-83997c398b01 req-f251b0b4-f9a8-4b98-9f4f-4731571c3ac3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061060 Jul 27 09:18:19.805213 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 482/952] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:18:19.849962 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:19.857801 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-640ef73d-72fd-415d-9618-ea24560b4ff1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 200 len: 1224 microversion: 2.1 time: 0.100028 Jul 27 09:18:19.859136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 471/953] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:19 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:18:20.880141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:20.880860 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:20.888100 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:20.888543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:20.889310 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:20.889741 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:20.903142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] HTTP exception thrown: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Request method failure captured: Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 HTTP/1.1 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QI6F71Hd2HRdP7dUu5SOhdMbScySFDcKh0ra5p-CGx1DAOfF-7Osa4B_8IWbTFiMNQXbEIO2EBTZoAYhgKaQ1NaLjBhNkE4LQuKzUfNmtiNDHgJRV9L3jwR68EjgvrdKQSUxwT6KQpNKtVJgbdjakg7U6saiz0VHXi5Atmrnmh1ZR0 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:18:20.904770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4bccf4907f0541b98f82a4313a0945e7"}]}] Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: f2fca61ad18948d0b24ca1a1a10ddfe4 Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:18:20.906430 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'f48566c0-5113-4e79-a7bb-6c464828c590'} Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:18:20.907452 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:18:20.909071 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:18:20.910490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Returning 404 to user: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:18:20.910490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-57a9a6cd-d868-45d3-894b-065e3d65eebe tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 404 len: 111 microversion: 2.1 time: 0.031585 Jul 27 09:18:20.910490 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 483/954] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:20 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:18:20.953610 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-772183414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-115497172", "security_groups": [{"name": "tempest-secgroup-smoke-1044509761"}], "block_device_mapping_v2": [{"uuid": "6f3bbb14-f9f7-48e2-aeae-ac6852438ae9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50a61881-b9b5-4c5d-9158-d7367ce8da5f"}]}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:18:21.064788 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] validate_networks() for [('50a61881-b9b5-4c5d-9158-d7367ce8da5f', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:18:21.659057 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:18:21.659308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Jul 27 09:18:21.697447 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:18:21.697870 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:18:21.698336 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:18:21.698741 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:18:21.699150 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:18:21.708556 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:21.708996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:21.709787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:21.710215 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:21.726881 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:18:21.730776 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for user f2fca61ad18948d0b24ca1a1a10ddfe4 and project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:18:21.808864 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:18:21.811041 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f3bbb14-f9f7-48e2-aeae-ac6852438ae9',volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:18:21.943641 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-cdc521ee-6071-4c91-9db9-a3ef3b682e7c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.993816 Jul 27 09:18:21.944326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 472/955] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:18:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:18:21.955279 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-ea7d0e8d-999d-4cbb-bd08-636628984a93 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:21.955925 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-ea7d0e8d-999d-4cbb-bd08-636628984a93 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:22.009567 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-ea7d0e8d-999d-4cbb-bd08-636628984a93 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:22.016588 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-ea7d0e8d-999d-4cbb-bd08-636628984a93 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1093 microversion: 2.1 time: 0.065418 Jul 27 09:18:22.017690 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 484/956] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:21 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:23.037897 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-61d84150-8a5c-4d85-8a64-c0dbdf49e827 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:23.038532 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-61d84150-8a5c-4d85-8a64-c0dbdf49e827 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:23.094275 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-61d84150-8a5c-4d85-8a64-c0dbdf49e827 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:23.101173 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-61d84150-8a5c-4d85-8a64-c0dbdf49e827 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1093 microversion: 2.1 time: 0.067548 Jul 27 09:18:23.101740 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 473/957] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:23 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:24.121061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-b2ec9324-fef3-40ae-af87-645d39939961 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:24.121903 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-b2ec9324-fef3-40ae-af87-645d39939961 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:24.179162 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-b2ec9324-fef3-40ae-af87-645d39939961 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:24.186418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-b2ec9324-fef3-40ae-af87-645d39939961 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1093 microversion: 2.1 time: 0.069309 Jul 27 09:18:24.186986 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 485/958] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:24 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:25.206511 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-4d639037-87ba-451d-8f4b-e2570f17c10e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:25.207125 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-4d639037-87ba-451d-8f4b-e2570f17c10e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:25.265947 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-4d639037-87ba-451d-8f4b-e2570f17c10e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:25.272651 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-4d639037-87ba-451d-8f4b-e2570f17c10e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1093 microversion: 2.1 time: 0.070040 Jul 27 09:18:25.273178 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 474/959] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:25 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:26.293800 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:26.294421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:26.301573 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:26.302024 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:26.302800 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:26.303239 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:26.363383 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:26.372869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-2d1621ab-344b-42c2-a8bf-54620f9f4546 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1143 microversion: 2.1 time: 0.081058 Jul 27 09:18:26.374801 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 486/960] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:26 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:27.396689 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:27.397301 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:27.406489 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:27.406937 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:27.408479 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:27.408911 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:27.474088 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:27.481760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-3ed23730-813e-472e-aba9-a9a1cb3be813 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1209 microversion: 2.1 time: 0.089470 Jul 27 09:18:27.482343 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 475/961] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:27 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:28.259967 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-e5e7df6c-51a7-4a9d-b853-af36602f7a79 req-19914c34-e33c-4b2b-8e7a-cdf4b8748176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f0d61-bb7c-4584-a957-bd8fbf173e48", "tag": "263ce83c-5f93-4be3-91ce-39aec894d10c"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:18:28.296050 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-e5e7df6c-51a7-4a9d-b853-af36602f7a79 req-19914c34-e33c-4b2b-8e7a-cdf4b8748176 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:28.296428 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-e5e7df6c-51a7-4a9d-b853-af36602f7a79 req-19914c34-e33c-4b2b-8e7a-cdf4b8748176 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:28.308740 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-e5e7df6c-51a7-4a9d-b853-af36602f7a79 req-19914c34-e33c-4b2b-8e7a-cdf4b8748176 service nova] Creating event network-changed:263ce83c-5f93-4be3-91ce-39aec894d10c for instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 on hv-cinder-79760 Jul 27 09:18:28.314473 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-e5e7df6c-51a7-4a9d-b853-af36602f7a79 req-19914c34-e33c-4b2b-8e7a-cdf4b8748176 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058556 Jul 27 09:18:28.315076 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 487/962] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:18:28.502915 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:28.503544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:28.509786 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:28.510235 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:28.511011 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:28.511711 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:28.644943 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:28.653168 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-27e2ec21-34cb-459c-b147-bdda928f9634 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.154383 Jul 27 09:18:28.653740 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 476/963] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:28 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:29.674357 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:29.675057 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:29.681953 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:29.682437 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:29.683228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:29.683671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:29.817663 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:29.825143 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-4c048345-f6ab-40f9-9e61-c33122feac9f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.155054 Jul 27 09:18:29.825715 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 488/964] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:29 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:30.847238 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:30.847877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:30.854387 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:30.854834 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:30.855601 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:30.856068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:30.990831 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:30.998333 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-02bdafca-41f6-43d2-9263-184ee7f569c8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.155700 Jul 27 09:18:30.998906 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 477/965] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:30 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:32.020457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:32.021174 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:32.027470 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:32.027949 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:32.028712 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:32.029142 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:32.159919 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:32.167364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-a2e00f72-97f6-4d2c-9f8d-924738f85051 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.150956 Jul 27 09:18:32.167952 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 489/966] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:32 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:33.188613 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:33.189796 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:33.191657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:33.197484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:33.197926 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:33.198724 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:33.199159 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:33.334787 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:33.342236 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6e17e198-57c7-4896-a0c8-80b47ec36c83 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.157506 Jul 27 09:18:33.342803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 478/967] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:33 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:34.363529 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:34.364122 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:34.366457 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=4 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:34.371974 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:34.372420 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:34.373194 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:34.373624 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:34.505803 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:34.513845 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fe6cc8f7-2051-4cd3-91b2-dfd89b988951 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.155026 Jul 27 09:18:34.514425 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 490/968] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:34 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:35.534991 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:35.535560 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:35.537852 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=10 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:35.543203 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:35.543652 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:35.544448 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:35.544886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:35.677519 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:35.685162 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-925ae93f-f24e-49d9-b2c5-98baf0a1c338 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.154124 Jul 27 09:18:35.685734 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 479/969] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:35 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:36.707638 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:36.708293 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:36.714792 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:36.715247 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:36.716055 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:36.716494 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:36.850707 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:36.858112 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7c6f405f-bf58-4842-a2a7-51328ab73e9d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.155079 Jul 27 09:18:36.858671 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 491/970] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:36 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:18:37.880710 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:37.881359 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:37.888314 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:37.888767 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:37.889570 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:37.890016 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:38.023189 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:38.030655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2b7a8419-ad60-4c1e-a15f-b843f46c396e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.153962 Jul 27 09:18:38.031214 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 480/971] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:37 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:39.050793 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:39.051442 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:39.057709 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:39.058158 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:39.058930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:39.059364 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:39.097785 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-fd4e9891-46b0-4d44-b706-7015209d78d4 req-0a15e361-ed37-4726-b4f7-e381630ca38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f0d61-bb7c-4584-a957-bd8fbf173e48", "name": "network-vif-plugged", "status": "completed", "tag": "263ce83c-5f93-4be3-91ce-39aec894d10c"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:18:39.110089 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fd4e9891-46b0-4d44-b706-7015209d78d4 req-0a15e361-ed37-4726-b4f7-e381630ca38d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:39.110760 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fd4e9891-46b0-4d44-b706-7015209d78d4 req-0a15e361-ed37-4726-b4f7-e381630ca38d service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:39.134466 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-fd4e9891-46b0-4d44-b706-7015209d78d4 req-0a15e361-ed37-4726-b4f7-e381630ca38d service nova] Creating event network-vif-plugged:263ce83c-5f93-4be3-91ce-39aec894d10c for instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 on hv-cinder-79760 Jul 27 09:18:39.143910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-fd4e9891-46b0-4d44-b706-7015209d78d4 req-0a15e361-ed37-4726-b4f7-e381630ca38d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050545 Jul 27 09:18:39.144549 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 481/972] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:18:39.197744 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:39.205835 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-325299b4-40a1-4c31-9cf9-e98b5233ab1e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.158901 Jul 27 09:18:39.206403 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 492/973] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:39 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:40.227346 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:40.228064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:40.234390 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:40.234830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:40.235627 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:40.236082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:40.378352 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:40.386784 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ed6e8022-2078-4f56-83b3-412d36c271b2 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1265 microversion: 2.1 time: 0.163775 Jul 27 09:18:40.387362 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 482/974] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:40 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:41.410480 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:41.411104 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:41.417896 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:41.418342 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:41.419116 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:41.419557 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:41.546354 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:41.553768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-be606f34-ba1d-4def-9bbb-2e873aff0f2c tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1452 microversion: 2.1 time: 0.147913 Jul 27 09:18:41.554336 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 493/975] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:41 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:41.573985 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:18:41.574599 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:18:41.581556 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:41.582003 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:41.582765 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:41.583207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:41.715223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:18:41.722790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-26f666c6-7e26-444a-a172-493335c44b47 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1452 microversion: 2.1 time: 0.152633 Jul 27 09:18:41.723355 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 483/976] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:18:41 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:18:43.385209 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-2cc0d4cc-a388-4bf3-ae75-3fe06809caad req-0fae073f-c78c-4575-aa01-08057892420a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f0d61-bb7c-4584-a957-bd8fbf173e48", "tag": "263ce83c-5f93-4be3-91ce-39aec894d10c"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:18:43.395402 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-2cc0d4cc-a388-4bf3-ae75-3fe06809caad req-0fae073f-c78c-4575-aa01-08057892420a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:18:43.395935 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-2cc0d4cc-a388-4bf3-ae75-3fe06809caad req-0fae073f-c78c-4575-aa01-08057892420a service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:18:43.407727 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-2cc0d4cc-a388-4bf3-ae75-3fe06809caad req-0fae073f-c78c-4575-aa01-08057892420a service nova] Creating event network-changed:263ce83c-5f93-4be3-91ce-39aec894d10c for instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 on hv-cinder-79760 Jul 27 09:18:43.413084 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-2cc0d4cc-a388-4bf3-ae75-3fe06809caad req-0fae073f-c78c-4575-aa01-08057892420a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087220 Jul 27 09:18:43.414074 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 494/977] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:19:15.442640 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:19:15.443306 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:19:15.547155 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:19:15.549472 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:15.555440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:15.555932 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:15.556694 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:15.557127 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:15.616453 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-a25302d1-03f9-4b3a-8aab-8ca2c72ef9e1 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action" status: 200 len: 14 microversion: 2.1 time: 0.179288 Jul 27 09:19:15.617055 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 484/978] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Jul 27 09:19:15 2022] POST /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 09:19:16.430875 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:16.431459 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:16.433520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-0876ed9b-bfaf-410e-bfcb-98d7fce303f8 req-79adae04-fcca-40b7-9484-53497e7d09c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:19:16.434037 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=32 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:19:16.434677 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=56 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:19:16.442131 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:16.442887 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:16.443675 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:16.444138 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:16.444896 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-0876ed9b-bfaf-410e-bfcb-98d7fce303f8 req-79adae04-fcca-40b7-9484-53497e7d09c4 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:16.445869 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-0876ed9b-bfaf-410e-bfcb-98d7fce303f8 req-79adae04-fcca-40b7-9484-53497e7d09c4 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:16.460584 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-0876ed9b-bfaf-410e-bfcb-98d7fce303f8 req-79adae04-fcca-40b7-9484-53497e7d09c4 service nova] Creating event network-changed:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:19:16.465921 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-0876ed9b-bfaf-410e-bfcb-98d7fce303f8 req-79adae04-fcca-40b7-9484-53497e7d09c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036532 Jul 27 09:19:16.466859 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 485/979] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:19:16.471207 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:19:16.558152 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8f43bf50-e105-4ec6-aa60-23daf7f84899 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 204 len: 0 microversion: 2.1 time: 0.131121 Jul 27 09:19:16.559597 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 495/980] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:19:16 2022] DELETE /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:19:16.568455 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:16.569527 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:16.576862 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:16.577639 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:16.579323 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:16.580010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:16.727486 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:19:16.735655 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-b2cee3f1-4bd7-4b69-9c28-587cd46a03de tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.171499 Jul 27 09:19:16.736254 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 486/981] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:19:16 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:19:17.758064 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:17.758770 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:17.765518 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:17.766634 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:17.767408 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:17.767884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:17.979779 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:19:17.987975 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-fdde2748-f95a-4561-acdc-2de84c86dd82 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1566 microversion: 2.1 time: 0.234249 Jul 27 09:19:17.988750 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 496/982] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:19:17 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:19:18.573485 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-a69e5a40-fc4a-415e-96b7-a9a2e5dbb39e req-2788aeba-3d2a-47b8-8b8a-210da1899483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb3afe7-8dbc-4d6f-9feb-61f254185bc8", "name": "network-vif-deleted", "tag": "477d606b-f4a5-41b1-8292-bb5e8e3f5f0e"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:19:18.586996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-a69e5a40-fc4a-415e-96b7-a9a2e5dbb39e req-2788aeba-3d2a-47b8-8b8a-210da1899483 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:18.587742 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-a69e5a40-fc4a-415e-96b7-a9a2e5dbb39e req-2788aeba-3d2a-47b8-8b8a-210da1899483 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:18.600064 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-a69e5a40-fc4a-415e-96b7-a9a2e5dbb39e req-2788aeba-3d2a-47b8-8b8a-210da1899483 service nova] Creating event network-vif-deleted:477d606b-f4a5-41b1-8292-bb5e8e3f5f0e for instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 on hv-cinder-79760 Jul 27 09:19:18.605285 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-a69e5a40-fc4a-415e-96b7-a9a2e5dbb39e req-2788aeba-3d2a-47b8-8b8a-210da1899483 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038440 Jul 27 09:19:18.605816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 487/983] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:19:19.009209 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:19.009808 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:19.017036 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:19.017499 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:19.018274 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:19.018720 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:19.052905 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:19.053278 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:19.053753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lazy-loading 'fault' on Instance uuid dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:19:19.104412 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee82f68deab411ca74c25f3b5200fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f864140a6ec742f8b825251c9f0b8719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:19:19.112437 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-677ca2f4-1bb9-4ce2-a684-def9005371a4 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 200 len: 1224 microversion: 2.1 time: 0.107167 Jul 27 09:19:19.113249 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 497/984] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:19:19 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:19:20.133835 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:20.134520 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] [instance: dbb3afe7-8dbc-4d6f-9feb-61f254185bc8] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:19:20.141664 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:20.142103 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:20.142850 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:19:20.143277 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:19:20.156222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] HTTP exception thrown: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Request method failure captured: Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 HTTP/1.1 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QGA8QjdVJYo_uct1QEqwQmPLUObq72C9dvXiBWPhq0y0bNxdGVuH9IVDCONj-HrMxFh8241snxXtAt-1zsvaUx_7qOkS5n1S3uIACHSNq358EF9wj6D7C3KuH7qqq6DI2WxRG58yqvgAAm5LZ8vZNQ3ULbmuLhE6QuQ1NdHVTf7NzQ Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: f864140a6ec742f8b825251c9f0b8719 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-TestShelveInstance-697411732 Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:19:20.157851 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f864140a6ec742f8b825251c9f0b8719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f864140a6ec742f8b825251c9f0b8719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f864140a6ec742f8b825251c9f0b8719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f864140a6ec742f8b825251c9f0b8719"}]}] Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-TestShelveInstance-697411732 Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: f864140a6ec742f8b825251c9f0b8719 Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-TestShelveInstance-697411732 Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-TestShelveInstance-697411732-project Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: 1ee82f68deab411ca74c25f3b5200fc7 Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-TestShelveInstance-697411732-project Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. Jul 27 09:19:20.159665 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'dbb3afe7-8dbc-4d6f-9feb-61f254185bc8'} Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:19:20.160607 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. Jul 27 09:19:20.161977 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:19:20.163213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Returning 404 to user: Instance dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:19:20.163213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-433c347c-f119-4f78-849d-cad95b07f2fa tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8" status: 404 len: 111 microversion: 2.1 time: 0.030099 Jul 27 09:19:20.163213 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 488/985] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:19:20 2022] GET /compute/v2.1/servers/dbb3afe7-8dbc-4d6f-9feb-61f254185bc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:19:20.316466 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3b37d99c-2ccb-448e-bcf9-0b95d9fa78f5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] Calling method '.version_select at 0x7f6f87ba58b0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:19:20.347202 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3b37d99c-2ccb-448e-bcf9-0b95d9fa78f5 tempest-TestShelveInstance-697411732 tempest-TestShelveInstance-697411732-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-163477883" status: 202 len: 0 microversion: 2.1 time: 0.035311 Jul 27 09:19:20.348141 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 498/986] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Jul 27 09:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-163477883 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:20:04.728840 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:20:04.729501 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:20:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:20:16.480806 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265053059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-115497172", "security_groups": [{"name": "tempest-secgroup-smoke-1044509761"}], "block_device_mapping_v2": [{"uuid": "b2b26692-6b46-4185-8f0e-82f94d615299", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "50a61881-b9b5-4c5d-9158-d7367ce8da5f"}]}} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:20:16.490242 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=10 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:16.490879 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=16 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:16.754618 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.network.neutron [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] validate_networks() for [('50a61881-b9b5-4c5d-9158-d7367ce8da5f', None, None, None, None, None)] {{(pid=117922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 09:20:17.123679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 09:20:17.124673 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image limits 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 09:20:17.125223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Flavor pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 09:20:17.125630 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Image pref 0:0:0 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 09:20:17.126039 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.virt.hardware [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 09:20:17.134803 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:17.135250 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:17.136086 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:17.136528 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:17.153629 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 09:20:17.157593 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.quota [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Getting quotas for user f2fca61ad18948d0b24ca1a1a10ddfe4 and project 4bccf4907f0541b98f82a4313a0945e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 09:20:17.213420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Going to run 1 instances... {{(pid=117922) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 09:20:17.215468 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2b26692-6b46-4185-8f0e-82f94d615299',volume_size=None,volume_type=None)] {{(pid=117922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 09:20:17.341951 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-57572c5c-0e1e-4e49-945b-690188dabce8 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865224 Jul 27 09:20:17.342726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 489/987] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Jul 27 09:20:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 09:20:17.351088 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:17.351900 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:17.356374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-53f4708c-e2f2-4832-bd9a-ccd91e6e4803 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:17.356992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-53f4708c-e2f2-4832-bd9a-ccd91e6e4803 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:17.526072 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-53f4708c-e2f2-4832-bd9a-ccd91e6e4803 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:17.533426 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-53f4708c-e2f2-4832-bd9a-ccd91e6e4803 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1093 microversion: 2.1 time: 0.183834 Jul 27 09:20:17.534009 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 499/988] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:17 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1093 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:18.555361 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:18.555912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:18.562889 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:18.563337 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:18.564136 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:18.564575 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:18.654481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:18.663091 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-fcb2a498-2f98-44d9-a658-4635cc279d1f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1209 microversion: 2.1 time: 0.112233 Jul 27 09:20:18.663679 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 490/989] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:18 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:19.681139 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [req-15bd240c-be22-458d-9856-2965b4248a29 req-9c7e4957-ee09-4e7c-8f29-c1ab78000b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4", "tag": "395f42a1-fb30-4876-ab6f-8846f441b7c4"}]} {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:20:19.697157 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:19.699773 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:19.699884 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-15bd240c-be22-458d-9856-2965b4248a29 req-9c7e4957-ee09-4e7c-8f29-c1ab78000b93 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:19.700332 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [req-15bd240c-be22-458d-9856-2965b4248a29 req-9c7e4957-ee09-4e7c-8f29-c1ab78000b93 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:19.716814 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:19.724987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:19.725994 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:19.727990 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:19.730210 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.compute.server_external_events [req-15bd240c-be22-458d-9856-2965b4248a29 req-9c7e4957-ee09-4e7c-8f29-c1ab78000b93 service nova] Creating event network-changed:395f42a1-fb30-4876-ab6f-8846f441b7c4 for instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 on hv-cinder-79760 Jul 27 09:20:19.737672 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [req-15bd240c-be22-458d-9856-2965b4248a29 req-9c7e4957-ee09-4e7c-8f29-c1ab78000b93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060743 Jul 27 09:20:19.738270 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 500/990] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:20:19.956558 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:19.964142 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-956b3b63-0ddd-4c51-bfd6-4f345c2fa02d tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.281045 Jul 27 09:20:19.964730 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 491/991] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:19 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:20:20.987245 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:20.988010 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:20.994296 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:20.994742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:20.995510 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:20.995974 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:21.129026 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:21.136537 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7f44026c-3600-4bda-b977-b73c377b4f9a tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.154718 Jul 27 09:20:21.137107 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 501/992] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:20 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:22.158436 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:22.159052 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:22.165621 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:22.166068 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:22.166838 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:22.167272 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:22.301444 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:22.308979 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-94dd5318-fc3a-481f-ad1c-fad498568584 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.155062 Jul 27 09:20:22.309544 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 492/993] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:22 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:23.330872 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:23.331488 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:23.337956 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:23.338399 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:23.339153 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:23.339583 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:23.467479 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:23.475724 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-52187b1c-22cb-4cf3-8fd1-8a7c931925f3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.149234 Jul 27 09:20:23.476374 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 502/994] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:23 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:24.497262 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:24.497877 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:24.504984 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:24.505452 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:24.506222 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:24.506649 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:24.638481 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:24.646794 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-ec634128-261d-4383-8605-046502d16b21 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.153683 Jul 27 09:20:24.647365 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 493/995] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:24 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:25.667294 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:25.667930 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:25.675082 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:25.675524 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:25.676308 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:25.676740 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:25.817022 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:25.824563 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-75f88184-2256-4a7c-8102-94a9a4a29b55 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.161137 Jul 27 09:20:25.825163 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 503/996] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:25 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:26.846042 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:26.846681 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:26.853445 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:26.853902 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:26.854684 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:26.855130 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:26.989415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:26.996898 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-578dce9e-55b5-4f20-af27-0c62a655e2da tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.155282 Jul 27 09:20:26.997460 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 494/997] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:26 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:28.018978 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:28.019594 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:28.022068 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell0:SELECT=2 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:28.027578 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:28.028058 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:28.028827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:28.029262 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:28.157280 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:28.164829 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-1460ff45-7acf-4a0c-b573-d7b84c1c6a3f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.149719 Jul 27 09:20:28.165401 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 504/998] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:28 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:29.184661 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:29.185308 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:29.187739 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=2 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:29.188424 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell0:SELECT=6 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:20:29.194964 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:29.195413 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:29.196220 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:29.196685 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:29.614115 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:29.622334 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2456710a-190b-4d70-ac3c-e3fb412e0dca tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.441906 Jul 27 09:20:29.622987 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 495/999] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:29 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:30.643469 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:30.644123 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:30.650572 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:30.651012 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:30.651792 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:30.652228 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:30.789742 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:30.797896 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-6772b5ad-6783-41d0-a8d0-c6260f69f57e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.158917 Jul 27 09:20:30.798472 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 505/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:30 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:31.555910 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-359c88da-08f4-47b9-a60a-6cdf3e8222aa req-dd7b5067-c2cf-44ab-84b1-71ed19b824de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4", "name": "network-vif-plugged", "status": "completed", "tag": "395f42a1-fb30-4876-ab6f-8846f441b7c4"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:20:31.566579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-359c88da-08f4-47b9-a60a-6cdf3e8222aa req-dd7b5067-c2cf-44ab-84b1-71ed19b824de service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:31.567029 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-359c88da-08f4-47b9-a60a-6cdf3e8222aa req-dd7b5067-c2cf-44ab-84b1-71ed19b824de service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:31.578321 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-359c88da-08f4-47b9-a60a-6cdf3e8222aa req-dd7b5067-c2cf-44ab-84b1-71ed19b824de service nova] Creating event network-vif-plugged:395f42a1-fb30-4876-ab6f-8846f441b7c4 for instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 on hv-cinder-79760 Jul 27 09:20:31.583312 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-359c88da-08f4-47b9-a60a-6cdf3e8222aa req-dd7b5067-c2cf-44ab-84b1-71ed19b824de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031211 Jul 27 09:20:31.583936 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 496/1001] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:20:31.818483 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:31.819338 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:31.826147 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:31.827135 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:31.828106 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:31.828551 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:31.971240 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:31.978669 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-c0aa6573-2f4f-402e-86d7-ad7f4dcd50d3 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1265 microversion: 2.1 time: 0.164037 Jul 27 09:20:31.979230 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 506/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:31 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:32.999636 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:33.000379 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:33.006579 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:33.007019 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:33.007816 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:33.008251 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:33.146536 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:33.155582 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-55a5a7da-bf65-4497-97c1-e960223ae5a7 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1453 microversion: 2.1 time: 0.160233 Jul 27 09:20:33.156218 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 497/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:32 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:33.175609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:20:33.176265 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:20:33.182834 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:33.183285 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:33.184094 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:33.184543 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:33.313753 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:20:33.321424 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-e987bf4b-d664-470e-a7f8-d402e627723f tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1453 microversion: 2.1 time: 0.149755 Jul 27 09:20:33.321992 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 507/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:20:33 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:20:34.927790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-6ee4b605-de62-4046-a5e8-394785d72894 req-fb125f2b-efe7-4045-8708-effe2f8555ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4", "tag": "395f42a1-fb30-4876-ab6f-8846f441b7c4"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:20:34.938207 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-6ee4b605-de62-4046-a5e8-394785d72894 req-fb125f2b-efe7-4045-8708-effe2f8555ee service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:20:34.938738 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-6ee4b605-de62-4046-a5e8-394785d72894 req-fb125f2b-efe7-4045-8708-effe2f8555ee service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:20:34.950804 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-6ee4b605-de62-4046-a5e8-394785d72894 req-fb125f2b-efe7-4045-8708-effe2f8555ee service nova] Creating event network-changed:395f42a1-fb30-4876-ab6f-8846f441b7c4 for instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 on hv-cinder-79760 Jul 27 09:20:34.955886 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-6ee4b605-de62-4046-a5e8-394785d72894 req-fb125f2b-efe7-4045-8708-effe2f8555ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031801 Jul 27 09:20:34.956830 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 498/1005] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:20:37.429899 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:20:37.430602 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:22:06.714029 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_api:SELECT=20 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:22:06.714955 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG dbcounter [-] [117923] Writing DB stats nova_cell1:SELECT=44 {{(pid=117923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:22:06.717612 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:22:06.718996 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG dbcounter [-] [117922] Writing DB stats nova_cell1:SELECT=48 {{(pid=117922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:22:06.720471 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:06.720995 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:06.724060 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-f46e5024-87a0-4107-826f-99060559b07b req-195d50d2-567b-4f06-aff6-fc65ba28d4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4", "tag": "395f42a1-fb30-4876-ab6f-8846f441b7c4"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:22:06.728811 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:06.729265 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:06.730053 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:06.731406 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:06.737010 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f46e5024-87a0-4107-826f-99060559b07b req-195d50d2-567b-4f06-aff6-fc65ba28d4fb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:06.737675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-f46e5024-87a0-4107-826f-99060559b07b req-195d50d2-567b-4f06-aff6-fc65ba28d4fb service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:06.749255 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-f46e5024-87a0-4107-826f-99060559b07b req-195d50d2-567b-4f06-aff6-fc65ba28d4fb service nova] Creating event network-changed:395f42a1-fb30-4876-ab6f-8846f441b7c4 for instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 on hv-cinder-79760 Jul 27 09:22:06.755577 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-f46e5024-87a0-4107-826f-99060559b07b req-195d50d2-567b-4f06-aff6-fc65ba28d4fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040643 Jul 27 09:22:06.757012 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 499/1006] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:22:06.759498 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:22:06.851163 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-28478ec9-fc98-4751-91e6-b291a97dad82 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 204 len: 0 microversion: 2.1 time: 0.138448 Jul 27 09:22:06.855144 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 508/1007] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:22:06 2022] DELETE /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:22:06.863223 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:06.864484 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:06.871686 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:06.872170 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:06.872953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:06.873415 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:07.036605 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:07.044327 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-6fd1bf4f-b6ba-4513-8dab-9455956b8347 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1577 microversion: 2.1 time: 0.187325 Jul 27 09:22:07.044903 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 500/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:06 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:22:08.066418 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:08.067165 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:08.074591 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:08.075075 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:08.075892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:08.076334 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:08.215517 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:08.223393 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-8050783d-7b95-4730-bb72-84a03ff1f543 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1577 microversion: 2.1 time: 0.161128 Jul 27 09:22:08.223914 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 509/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:08 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:22:08.884721 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-670d45fd-ceaa-41e2-8ef2-70898d8a4a84 req-2c183fdf-f346-48bb-9ccc-8bc506ee8bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4", "name": "network-vif-deleted", "tag": "395f42a1-fb30-4876-ab6f-8846f441b7c4"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:22:08.894974 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-670d45fd-ceaa-41e2-8ef2-70898d8a4a84 req-2c183fdf-f346-48bb-9ccc-8bc506ee8bc8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:08.895410 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-670d45fd-ceaa-41e2-8ef2-70898d8a4a84 req-2c183fdf-f346-48bb-9ccc-8bc506ee8bc8 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:08.907525 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-670d45fd-ceaa-41e2-8ef2-70898d8a4a84 req-2c183fdf-f346-48bb-9ccc-8bc506ee8bc8 service nova] Creating event network-vif-deleted:395f42a1-fb30-4876-ab6f-8846f441b7c4 for instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 on hv-cinder-79760 Jul 27 09:22:08.913036 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-670d45fd-ceaa-41e2-8ef2-70898d8a4a84 req-2c183fdf-f346-48bb-9ccc-8bc506ee8bc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 Jul 27 09:22:08.913837 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 501/1010] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:22:09.247827 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:09.248454 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:09.255620 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:09.256113 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:09.256950 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:09.257540 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:09.291435 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:09.291916 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:09.292371 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lazy-loading 'fault' on Instance uuid 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:22:09.334191 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:09.343015 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-aa209527-4d3e-469c-a760-8aff66af0ee1 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 200 len: 1229 microversion: 2.1 time: 0.100529 Jul 27 09:22:09.343601 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 510/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:09 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:22:10.364968 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:10.365671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:10.371984 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:10.372440 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:10.373225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:10.373658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:10.387390 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] HTTP exception thrown: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Request method failure captured: Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 HTTP/1.1 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QI6F71Hd2HRdP7dUu5SOhdMbScySFDcKh0ra5p-CGx1DAOfF-7Osa4B_8IWbTFiMNQXbEIO2EBTZoAYhgKaQ1NaLjBhNkE4LQuKzUfNmtiNDHgJRV9L3jwR68EjgvrdKQSUxwT6KQpNKtVJgbdjakg7U6saiz0VHXi5Atmrnmh1ZR0 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:22:10.389085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4bccf4907f0541b98f82a4313a0945e7"}]}] Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: f2fca61ad18948d0b24ca1a1a10ddfe4 Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. Jul 27 09:22:10.391082 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4'} Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:22:10.392118 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. Jul 27 09:22:10.393756 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:10.395225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Returning 404 to user: Instance 7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:22:10.395225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-9b794b1e-ef1a-4101-a8e5-a6444acad542 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4" status: 404 len: 111 microversion: 2.1 time: 0.030512 Jul 27 09:22:10.395225 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 502/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:10 2022] GET /compute/v2.1/servers/7d6c05cd-da3b-4388-9db7-6ccbb3a7eae4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:22:13.509547 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:13.510885 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:13.514069 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-3bed6cb2-e0d9-4204-873f-00733e791fa9 req-fb73aa76-f639-4e29-aa59-7926b2b1b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f0d61-bb7c-4584-a957-bd8fbf173e48", "tag": "263ce83c-5f93-4be3-91ce-39aec894d10c"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:22:13.524503 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:13.525361 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:13.526788 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:13.528220 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:13.531772 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-3bed6cb2-e0d9-4204-873f-00733e791fa9 req-fb73aa76-f639-4e29-aa59-7926b2b1b0a0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:13.532614 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-3bed6cb2-e0d9-4204-873f-00733e791fa9 req-fb73aa76-f639-4e29-aa59-7926b2b1b0a0 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:13.545759 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-3bed6cb2-e0d9-4204-873f-00733e791fa9 req-fb73aa76-f639-4e29-aa59-7926b2b1b0a0 service nova] Creating event network-changed:263ce83c-5f93-4be3-91ce-39aec894d10c for instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 on hv-cinder-79760 Jul 27 09:22:13.552790 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-3bed6cb2-e0d9-4204-873f-00733e791fa9 req-fb73aa76-f639-4e29-aa59-7926b2b1b0a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046873 Jul 27 09:22:13.553778 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 503/1013] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 09:22:13.566223 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Going to try to terminate instance {{(pid=117923) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 09:22:13.666453 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7de9a8fd-77e5-4295-9f3a-bb564f947f6b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 204 len: 0 microversion: 2.1 time: 0.164587 Jul 27 09:22:13.670908 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:22:13 2022] DELETE /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 09:22:13.682300 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:13.683959 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:13.696135 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:13.696586 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:13.697372 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:13.698657 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:13.852471 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.policy [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117922) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:13.860074 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-edd15573-bee2-42c5-98be-3d4afa7fb428 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1575 microversion: 2.1 time: 0.187475 Jul 27 09:22:13.860658 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 504/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:13 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 09:22:14.884176 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:14.885000 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:14.893061 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:14.893853 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:14.894662 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:14.895099 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:15.036869 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:15.044650 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-9752751d-65f9-404e-ab58-5677918b8a76 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1575 microversion: 2.1 time: 0.166422 Jul 27 09:22:15.045234 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 512/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:14 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:22:15.661671 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [req-fdfde65e-170a-4ce5-a4b5-3d8da4e8cac1 req-9b386abf-23c4-4fac-b8e9-85ade1682189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f0d61-bb7c-4584-a957-bd8fbf173e48", "name": "network-vif-deleted", "tag": "263ce83c-5f93-4be3-91ce-39aec894d10c"}]} {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 09:22:15.671353 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fdfde65e-170a-4ce5-a4b5-3d8da4e8cac1 req-9b386abf-23c4-4fac-b8e9-85ade1682189 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:15.671826 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [req-fdfde65e-170a-4ce5-a4b5-3d8da4e8cac1 req-9b386abf-23c4-4fac-b8e9-85ade1682189 service nova] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:15.682953 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.compute.server_external_events [req-fdfde65e-170a-4ce5-a4b5-3d8da4e8cac1 req-9b386abf-23c4-4fac-b8e9-85ade1682189 service nova] Creating event network-vif-deleted:263ce83c-5f93-4be3-91ce-39aec894d10c for instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 on hv-cinder-79760 Jul 27 09:22:15.687675 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [req-fdfde65e-170a-4ce5-a4b5-3d8da4e8cac1 req-9b386abf-23c4-4fac-b8e9-85ade1682189 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094301 Jul 27 09:22:15.688316 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 505/1017] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Jul 27 09:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 09:22:16.067074 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:16.067694 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:16.075892 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:16.076351 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:16.077233 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:16.077684 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:16.114200 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:16.114651 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:16.115155 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.objects.instance [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lazy-loading 'fault' on Instance uuid 854f0d61-bb7c-4584-a957-bd8fbf173e48 {{(pid=117923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 09:22:16.160391 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.policy [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2fca61ad18948d0b24ca1a1a10ddfe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bccf4907f0541b98f82a4313a0945e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117923) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 09:22:16.168098 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-7e6dcdfb-94a9-4fbf-b535-3bdea456677e tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 200 len: 1229 microversion: 2.1 time: 0.104800 Jul 27 09:22:16.168677 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 513/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:16 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 09:22:17.190552 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:17.191280 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: 854f0d61-bb7c-4584-a957-bd8fbf173e48] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:17.197503 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.197949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.199726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.199726 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.213105 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] HTTP exception thrown: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Request method failure captured: Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 HTTP/1.1 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QI6F71Hd2HRdP7dUu5SOhdMbScySFDcKh0ra5p-CGx1DAOfF-7Osa4B_8IWbTFiMNQXbEIO2EBTZoAYhgKaQ1NaLjBhNkE4LQuKzUfNmtiNDHgJRV9L3jwR68EjgvrdKQSUxwT6KQpNKtVJgbdjakg7U6saiz0VHXi5Atmrnmh1ZR0 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:22:17.215433 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4bccf4907f0541b98f82a4313a0945e7"}]}] Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: f2fca61ad18948d0b24ca1a1a10ddfe4 Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. Jul 27 09:22:17.217085 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': '854f0d61-bb7c-4584-a957-bd8fbf173e48'} Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:22:17.218396 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. Jul 27 09:22:17.219949 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.221420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Returning 404 to user: Instance 854f0d61-bb7c-4584-a957-bd8fbf173e48 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:22:17.221420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-2ada9ecd-c1be-4000-9942-00caea10e682 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48" status: 404 len: 111 microversion: 2.1 time: 0.031559 Jul 27 09:22:17.221420 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 506/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:17 2022] GET /compute/v2.1/servers/854f0d61-bb7c-4584-a957-bd8fbf173e48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:22:17.682768 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:17.683948 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.compute.api [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117923) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:17.690609 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.691051 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.691865 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.692407 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG oslo_concurrency.lockutils [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.705739 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.wsgi [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] HTTP exception thrown: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Request method failure captured: Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: request: DELETE /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 HTTP/1.1 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept: application/json Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Accept-Encoding: identity Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Connection: close Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Length: 0 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Content-Type: application/json Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Host: 10.222.0.33 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Openstack-System-Scope: None Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: User-Agent: python-urllib3/1.26.10 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Auth-Token: gAAAAABi4QI6F71Hd2HRdP7dUu5SOhdMbScySFDcKh0ra5p-CGx1DAOfF-7Osa4B_8IWbTFiMNQXbEIO2EBTZoAYhgKaQ1NaLjBhNkE4LQuKzUfNmtiNDHgJRV9L3jwR68EjgvrdKQSUxwT6KQpNKtVJgbdjakg7U6saiz0VHXi5Atmrnmh1ZR0 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Id: None Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Domain-Name: None Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Identity-Status: Confirmed Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Is-Admin-Project: True Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Id: default Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Domain-Name: Default Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Project-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Role: reader,member Jul 27 09:22:17.707421 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Roles: reader,member Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4bccf4907f0541b98f82a4313a0945e7"}]}] Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Id: default Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Domain-Name: Default Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Id: f2fca61ad18948d0b24ca1a1a10ddfe4 Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: X-User-Name: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: method: > Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: exception: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.709258 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: action_args: {'id': 'f48566c0-5113-4e79-a7bb-6c464828c590'} Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:22:17.710331 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.711826 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.713555 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Returning 404 to user: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. {{(pid=117923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:22:17.713555 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-3721d0b4-b7c1-418c-9cda-4c300a16e3b9 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 404 len: 111 microversion: 2.1 time: 0.029982 Jul 27 09:22:17.713555 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 514/1020] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Jul 27 09:22:17 2022] DELETE /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:22:17.719182 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '>' {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:17.719872 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.compute.api [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] [instance: f48566c0-5113-4e79-a7bb-6c464828c590] Fetching instance by UUID {{(pid=117922) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 09:22:17.725912 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.726359 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.727124 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 09:22:17.727564 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG oslo_concurrency.lockutils [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Lock "c62e0045-c296-455f-b1a2-d948df83e410" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 09:22:17.741326 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.wsgi [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] HTTP exception thrown: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Request method failure captured: Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: request: GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 HTTP/1.1 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept: application/json Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Accept-Encoding: identity Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Connection: close Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Length: 0 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Content-Type: application/json Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Host: 10.222.0.33 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Openstack-System-Scope: None Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: User-Agent: python-urllib3/1.26.10 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Auth-Token: gAAAAABi4QI6F71Hd2HRdP7dUu5SOhdMbScySFDcKh0ra5p-CGx1DAOfF-7Osa4B_8IWbTFiMNQXbEIO2EBTZoAYhgKaQ1NaLjBhNkE4LQuKzUfNmtiNDHgJRV9L3jwR68EjgvrdKQSUxwT6KQpNKtVJgbdjakg7U6saiz0VHXi5Atmrnmh1ZR0 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Id: None Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Domain-Name: None Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Identity-Status: Confirmed Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Is-Admin-Project: True Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Id: default Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Domain-Name: Default Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Project-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Role: reader,member Jul 27 09:22:17.742842 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Roles: reader,member Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4bccf4907f0541b98f82a4313a0945e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4bccf4907f0541b98f82a4313a0945e7"}]}] Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Id: 4bccf4907f0541b98f82a4313a0945e7 Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249939963 Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Id: default Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Domain-Name: Default Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Id: f2fca61ad18948d0b24ca1a1a10ddfe4 Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: X-User-Name: tempest-TestVolumeBootPattern-1249939963-project Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: method: > Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: exception: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.744573 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: action_args: {'id': 'f48566c0-5113-4e79-a7bb-6c464828c590'} Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: {{(pid=117922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 09:22:17.745405 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. Jul 27 09:22:17.747446 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: ERROR nova.api.openstack.wsgi Jul 27 09:22:17.748840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: DEBUG nova.api.openstack.wsgi [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Returning 404 to user: Instance f48566c0-5113-4e79-a7bb-6c464828c590 could not be found. {{(pid=117922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 09:22:17.748840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO nova.api.openstack.requestlog [None req-935a8120-15c4-492a-858d-20a022042c7b tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590" status: 404 len: 111 microversion: 2.1 time: 0.029349 Jul 27 09:22:17.748840 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: [pid: 117922|app: 0|req: 507/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Jul 27 09:22:17 2022] GET /compute/v2.1/servers/f48566c0-5113-4e79-a7bb-6c464828c590 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 09:22:19.049696 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: DEBUG nova.api.openstack.wsgi [None req-bd48634d-6328-4d8e-8c3b-9ceb538e2516 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] Calling method '.version_select at 0x7f6f87d6a0d0>' {{(pid=117923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 09:22:19.070891 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO nova.api.openstack.requestlog [None req-bd48634d-6328-4d8e-8c3b-9ceb538e2516 tempest-TestVolumeBootPattern-1249939963 tempest-TestVolumeBootPattern-1249939963-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-115497172" status: 202 len: 0 microversion: 2.1 time: 0.025057 Jul 27 09:22:19.071473 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: [pid: 117923|app: 0|req: 515/1022] 10.222.0.33 () {58 vars in 1260 bytes} [Wed Jul 27 09:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-115497172 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 09:23:21.669146 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:23:21.669797 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:23:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:23:24.738067 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:23:24.738606 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:23:57.438226 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:23:57.438871 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:23:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:25:19.655560 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:25:19.656331 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:25:23.815004 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:25:23.815661 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:26:41.677459 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:26:41.678092 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:26:44.747104 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:26:44.747728 dv-cinder-797608-64-iscsi devstack@n-api.service[117923]: Wed Jul 27 09:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:27:17.446482 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:27:17.447224 dv-cinder-797608-64-iscsi devstack@n-api.service[117922]: Wed Jul 27 09:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!